Practice P-Value in Math

Use these practice problems to test your method after reviewing the concept explanation and worked examples.

Quick Recap

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H0 is true.

A p-value is a surprise meter that assumes nothing special is going on. A friend says she is an average free-throw shooter, then sinks 20 shots in a row; you ask how often an average shooter would do that. The rarer that is under her story, the less you believe the story. The meter rates the data, not the story's probability.

Showing a random 20 of 50 problems.

Example 1

challenge
Show why, under H0, P(p-value≤α)=α, and connect this to the Type I error rate.

Example 2

easy
Define in words what a p-value measures.

Example 3

medium
Fill in: if the p-value is below α, the result is called statistically ____.

Example 4

easy
A two-sided test has one-tail area 0.015. What is the p-value?

Example 5

medium
A p-value of exactly α leads to what conclusion under the convention p≤α?

Example 6

easy
True or false: the p-value is the probability that H0 is true.

Example 7

medium
A two-sided test produces z=−1.96 with P(Z<−1.96)=0.025. Find the p-value.

Example 8

medium
A test gives p=0.30. A student writes 'there is a 30% chance H0 is true.' Correct the interpretation.

Example 9

easy
True or false: a p-value of 0.0001 proves the alternative hypothesis is true.

Example 10

medium
A study reports p=0.045. A reader claims 'there is a 4.5% chance the treatment has no effect.' Why is this wrong?

Example 11

challenge
A test statistic has p-value 0.04. The researcher then collects more data hoping to 'confirm' significance, stopping when p<0.05 again. Why does this invalidate the p-value?

Example 12

easy
Fill in the blank: A small p-value is evidence ____ the null hypothesis.

Example 13

challenge
Prove: if the test statistic T has a continuous distribution under H0, then the p-value P=P(T≥Tobs∣H0) is uniformly distributed on (0,1) when H0 holds.

Example 14

easy
A right-tailed test produces z=0.5. Use P(Z>0.5)=0.3085 to find the p-value and decide at α=0.05.

Example 15

hard
A t-test with df=9 produces t=2.262, the critical value for α=0.05 two-sided. Find the p-value.

Example 16

easy
A one-tailed test has z=1.7. Find the p-value and determine if we reject H0 at α=0.05.

Example 17

hard
A study reports 'no significant difference, p=0.32.' Can we conclude there is no difference between groups?

Example 18

hard
Correct the following misconceptions about p-values: (a) 'p=0.03 means there's a 3% chance H₀ is true.' (b) 'p=0.03 means the effect is large.'

Example 19

challenge
A journal publishes only p<0.05 results. Explain why published effect sizes tend to be overstated (the 'winner's curse').

Example 20

medium
A hypothesis test produces z=2.3 for a two-tailed test. Calculate the p-value and interpret it at both α=0.05 and α=0.01.