[New Users] Please note that all new users need to be approved before posting. This process can take up to 24 hours. Thank you for your patience.
Check out the v.256 - The Dark Ride: Limbo Patch Notes here!
If this is your first visit, be sure to check out the Forums Code of Conduct: https://forums.maplestory.nexon.net/discussion/29556/code-of-conducts

CSS 10% ISSUES

FreeShootFreeShoot
Reactions: 315
Posts: 4
Member, Private Tester
edited July 2017 in Suggestions, Feedback, and Requests
Hello,
I recently did some testing involving CSS10% and I discovered that the chance of the scrolls is not very faithful to your chance of success. See test images (Reliable test for 99.85%)

oZxbLDI.png

Please, tell me if you have a similar problem.

Comments

  • NeospectorNeospector
    Reactions: 9,860
    Posts: 2,146
    Volunteer Forum Moderator
    edited July 2017
    You're using chi-squared distribution to calculate the overall probability?

    χ² is the cumulative test statistic:
    Σ((O-E)²/(E)
    This can be used to calculate the probability of seeing x number of successes in n trials, but you're stopping after your first success, which is odd for this distribution. For a chi-squared distribution you should be using a fixed number of trials and observing the success rates in that number of trials.
    If you're stopping after 1 success, You may wish to consider a Geometric distribution instead:

    µ=1/p
    σ² = (1−p)/p²
    Where the probability of finding the first success after n trials is Σp(1−p)^(n−1)
    Or, for this specific case:
    0.1 * (0.9)^9 + 0.1 * (0.9)^8 + 0.1 * (0.9)^7 + 0.1 * (0.9)^6 + 0.1 * (0.9)^5 + 0.1 * (0.9)^4 + 0.1 * (0.9)^3 + 0.1 * (0.9)^2 + 0.1 * (0.9) + 0.1
    Or a 0.6513215599 (~65% chance) that a scroll will succeed within the first 10 trials.

    I'm not sure what your p-value is supposed to represent, usually a chi-squared test is useful in testing the probability that one particular mean is equal to, less than, or greater than another mean in another sample. There's not enough data presented to determine what's likely.
    Which might be why you received a warning message stating your approximation may be incorrect.
  • FreeShootFreeShoot
    Reactions: 315
    Posts: 4
    Member, Private Tester
    edited July 2017
    Neospector wrote: »
    You're using chi-squared distribution to calculate the overall probability?

    χ² is the cumulative test statistic:
    Σ((O-E)²/(E)
    This can be used to calculate the probability of seeing x number of successes in n trials, but you're stopping after your first success, which is odd for this distribution. For a chi-squared distribution you should be using a fixed number of trials and observing the success rates in that number of trials.
    If you're stopping after 1 success, You may wish to consider a Geometric distribution instead:

    µ=1/p
    σ² = (1−p)/p²
    Where the probability of finding the first success after n trials is Σp(1−p)^(n−1)
    Or, for this specific case:
    0.1 * (0.9)^9 + 0.1 * (0.9)^8 + 0.1 * (0.9)^7 + 0.1 * (0.9)^6 + 0.1 * (0.9)^5 + 0.1 * (0.9)^4 + 0.1 * (0.9)^3 + 0.1 * (0.9)^2 + 0.1 * (0.9) + 0.1
    Or a 0.6513215599 (~65% chance) that a scroll will succeed within the first 10 trials.

    I'm not sure what your p-value is supposed to represent, usually a chi-squared test is useful in testing the probability that one particular mean is equal to, less than, or greater than another mean in another sample. There's not enough data presented to determine what's likely.
    Which might be why you received a warning message stating your approximation may be incorrect.


    I'm not testing the probabiity, i'm testing the adherence of variables, exists a lot of qui-squared tests and p-vaue means the confiability of test(0.0015 means ¨the test is good for 99.85% of cases)