Error Rates of a Binomial Test
A coin is tossed times, and denotes the number of heads observed. To test the null hypothesis that the coin is fair () against the alternative that it is not, you adopt the rejection region . Find the significance level of this test (the probability of rejecting when the coin is in fact fair), to the nearest thousandth.
Work it out, then compare with the answer.
SolutionShow the worked solution
Under we have . The test rejects when or , so it is simplest to compute the complement:
The distribution is symmetric about . The coefficients follow from by the ratio :
Hence
Since ,
Key idea. The significance level is the -probability of the rejection region. The normal approximation with continuity correction gives and confirms the result.
Variations
The same idea with a twist. Each solution gives only the changed step.
A coin is tossed times, and denotes the number of heads observed. To test the null hypothesis that the coin is fair against the alternative that it is biased, you use the rejection region . Suppose the true heads probability is actually . Find the probability of failing to reject (i.e. ) in this case, to the nearest ten-thousandth.
Work it out, then compare with the answer.
Solution
Now . We fail to reject exactly when , so
The largest term is .
Each smaller term follows from the ratio . Writing every term as a multiple of , the multipliers for are
They sum to , so
The value lies just above , so it rounds up.