Power of a Test Formula
Power of a test is the probability that a hypothesis test correctly rejects a false null hypothesis.
The Formula
Ask yourself: Am I asking for the probability of correctly rejecting the null GIVEN it is false (the detection rate)?
Quick example
Notation
What this formula means
The probability that a hypothesis test correctly rejects a false null hypothesis. Power , where is the probability of a Type II error.
Power works like a fishing net's chance of landing a fish that really is in the lake. A bigger fish (a larger effect) or a finer mesh (a larger sample) raises the catch rate. Unlike a net, a test can also 'catch' a fish that is not there; that false catch is , a separate number.
Formal view
Worked examples
Example 1
mediumShow solution
Answer
First step
See the full worked solution + why-it-works coaching
SetupKey insightWhy it worksCommon pitfallConnection
Example 2
hardExample 3
mediumCommon mistakes
- Confusing power with - power conditions on being FALSE; conditions on being TRUE.
- Thinking power and add to nothing useful - power , so a Type II error rate of 0.2 means power 0.8.
- Believing a non-significant result proves no effect - a low-power test often misses real effects, so 'not significant' isn't 'no effect.'
Why this formula matters
Power tells you whether a study could ever have found what it was looking for. With it you can choose a sample size before collecting any data, and you can read a 'not significant' result correctly: from a high-power study it suggests the effect is small or absent, but from a low-power study it says almost nothing. Ignoring power produces small studies that miss treatments that really work, followed by false claims of 'no effect'.
Frequently asked questions
What is the Power of a Test formula?
The probability that a hypothesis test correctly rejects a false null hypothesis. Power , where is the probability of a Type II error.
How do you use the Power of a Test formula?
Reach for power when the problem says the effect is real or the null is false and asks how likely the test is to detect it, or when it asks how large a sample a study needs. It also belongs in any discussion of a 'not significant' result. If the problem describes a true null and a wrong rejection, that is ; if it asks how often a real effect is missed, that is ; if it asks how often an interval captures a parameter, that is a confidence level.
What do the symbols mean in the Power of a Test formula?
Power . .
Why is the Power of a Test formula important in Math?
Power tells you whether a study could ever have found what it was looking for. With it you can choose a sample size before collecting any data, and you can read a 'not significant' result correctly: from a high-power study it suggests the effect is small or absent, but from a low-power study it says almost nothing. Ignoring power produces small studies that miss treatments that really work, followed by false claims of 'no effect'.
What do students get wrong about Power of a Test?
The procedure for power of a test is the easy part; the trap is confusing power with . Asking "Am I asking for the probability of correctly rejecting the null GIVEN it is false (the detection rate)?" first is what keeps a correct-looking calculation from being attached to the wrong concept.
What should I learn before the Power of a Test formula?
Before studying the Power of a Test formula, you should understand: type i type ii errors, hypothesis testing, sampling distribution.