The old probability of H has become the new probability of H.
Thomas Bayes’s theorem offers a means of calculating P(H|E)
P(H|E) = P(H)P(E|H)/P(E).
Notice that
P(H|E)= P(H)P(E|H)/[P(H)P(E|H) + P(~H)P(E|~H)].
Consider the hypothesis H that a coin is fair. Remember that the coin
has been tossed twenty times. Remember that on four occasions, it came
up heads. Call that heads-up E.
Suppose that P(H) is 0.5.
P(E) is thus [(0.5 × 0.0046) + (0.5 × 0.0911)]
Now look at this:
P(H) = [0.5 × 0.0046]/[(0.5 × 0.0046) + (0.5 × 0.0911)] = 0.0481.
Up the coin has gone, but down has come the probability that the coin is fair.
In Fisher’s method of significance testing there is no appeal to the
prior probabilities of H and E. There is just the probability of E given
H.
Significance testing is meant to lead to a decision. It has an
unavoidably active aspect. Either H should be accepted or not, but, in
either case, something must be done.
The imperative of action is to reject H, if, and only if, the test results are improbable given the hypothesis.
In coin tossing, toss-ups are covered by a probability distribution
curve. The coin has been tossed twenty times. At one end of the curve,
there are four or fewer heads. At the other, four or fewer tails. Such
are the critical regions of improbable results. The probability of a
test result matching the real result is 0.012. This is less than a
significance level of 0.05.
Give it up. The coin is not fair.
Well, neither is life.
But notice this: Fisher’s test shows only that either H is false or that the test results are improbable....MORE