Practice Type I and Type II Errors in Math

Use these practice problems to test your method after reviewing the concept explanation and worked examples.

Quick Recap

Type I error (α): rejecting H0 when it is actually true (false positive). Type II error (β): failing to reject H0 when it is actually false (false negative).

Think of a medical test. Type I error: the test says you have a disease when you don't (false alarm). Type II error: the test says you're healthy when you actually have the disease (missed detection). A smoke alarm that goes off when there's no fire is a Type I error; one that stays silent during a real fire is a Type II error. You can't eliminate both—reducing one tends to increase the other.

Showing a random 20 of 50 problems.

Example 1

hard
A medical test has α=0.05 and β=0.20 (Power = 0.80). If the true disease rate is 5% in the population: (a) in 100 truly diseased patients, how many will be missed? (b) In 1000 truly healthy patients, how many will get false positives?

Example 2

challenge
Explain why, holding the sample size fixed, you cannot simultaneously reduce both α and β.

Example 3

challenge
Two tests are proposed. Test A: α=0.10, power 0.95. Test B: α=0.01, power 0.70. For detecting a deadly disease where missing a case is far worse than a false alarm, which test is preferable and why?

Example 4

hard
Holding α fixed, which of these does NOT change power: (a) sample size n, (b) significance level α, (c) effect size, (d) population σ?

Example 5

medium
Decreasing α from 0.05 to 0.01 (same n) has what effect on the Type II error rate β?

Example 6

easy
A drug actually works but the test fails to reject the 'no effect' null. Which error?

Example 7

easy
The probability of a Type I error is denoted by which Greek letter?

Example 8

medium
A test has α=0.05 and power 0.80 for a specific alternative. (a) Find β. (b) Among 100 truly different samples, roughly how many will the test miss?

Example 9

hard
A factory quality test accepts shipments if sample defect rate is below 5%. H0: defect rate ≤ 5% (accept). Type I: reject good shipment. Type II: accept bad shipment. Which error is more costly for the factory, and how should this affect choice of α?

Example 10

easy
A medical test says a healthy person has a disease. Which error is this?

Example 11

easy
A Type I error is sometimes called a ____ positive.

Example 12

easy
If β=0.25, what is the power of the test?

Example 13

medium
A test has α=0.05 and β=0.10. Find the power and the probability of a false positive when H0 is true.

Example 14

hard
Disease prevalence is 2%. A test has α=0.05 and power 0.80. Out of 10000 screened, roughly how many TRUE positives are expected?

Example 15

medium
A juror convicts an innocent defendant. With H0: 'innocent', which error type is this?

Example 16

easy
Statistical power is defined as which quantity?

Example 17

easy
True or false: α+β=1 in general.

Example 18

hard
Test A: α=0.05, power 0.50. Test B: α=0.05, power 0.90. Which test is preferable for detecting a real effect, and why?

Example 19

medium
True or false: increasing the effect size (difference between truth and H0 value) increases power.

Example 20

easy
Rejecting H0 when H0 is actually true is which type of error?