Statistical Significance Examples: 44 Problems with Answers
Worked examples of Statistical Significance to try before you open each solution, then practice problems with answers.
Worked Examples
Example 1
mediumShow solution
Answer
First step
See the full worked solution + why-it-works coaching
SetupKey insightWhy it worksCommon pitfallConnection
Example 2
hardExample 3
hardExample 4
challengeExample 5
hardExample 6
hardPractice Problems
Try each one, then open the solution to compare your method.
Example 1
easyExample 2
easyExample 3
easyExample 4
easyExample 5
easyExample 6
easyExample 7
easyExample 8
easyExample 9
mediumExample 10
mediumExample 11
mediumExample 12
mediumExample 13
mediumExample 14
mediumExample 15
mediumExample 16
mediumExample 17
mediumExample 18
challengeExample 19
challengeExample 20
challengeExample 21
easyExample 22
easyExample 23
easyExample 24
easyExample 25
mediumExample 26
mediumExample 27
mediumExample 28
mediumExample 29
mediumExample 30
mediumExample 31
hardExample 32
hardExample 33
hardExample 34
mediumExample 35
mediumExample 36
hardExample 37
hardExample 38
hardWhat to focus on
Core idea: Fix a threshold before seeing the data and call a result significant when . That rule wrongly rejects a true null only of the time, but it says nothing about how large or important the effect is.
Common stuck point: Students often know a procedure related to statistical significance but skip the recognition step: Must you give a yes-or-no verdict by comparing a p-value with a threshold chosen before the data came in? That leads to a calculation or graph that looks reasonable but answers a different question.
Ask yourself: Must you give a yes-or-no verdict by comparing a p-value with a threshold chosen before the data came in?
Concept recap
A result is statistically significant when the p-value falls below a predetermined threshold (alpha, typically 0.05), indicating that the observed effect is unlikely to have occurred by random chance alone. Statistical significance is a binary decision criterion used in hypothesis testing — it does not measure the size or practical importance of the effect.
A smoke alarm with a sensitivity dial works like a significance test. You set the dial () before cooking; at 0.05, the alarm sounds on about 5% of smoke-free days. A beep means "probably not just chance", not "big fire": burnt toast and a house fire both set it off. And silence does not prove there is no smoke.
Read the full lesson on Statistical SignificanceStatistical Significance is covered with related ideas in the guide Experimental Design: Confounding Variables, Control Groups, Random Assignment and Blinding.
Related concepts
Background knowledge
These ideas may be useful before you work through the harder examples.