Power of a Test Formula

Power of a test is the probability that a hypothesis test correctly rejects a false null hypothesis.

The Formula

Power=1β=P(reject H0H0 is false)\text{Power} = 1 - \beta = P(\text{reject } H_0 \mid H_0 \text{ is false})

When to use: Power is your test's ability to detect a real effect when one exists. A test with high power is like a sensitive metal detector—it won't miss a coin buried in the sand. A test with low power is like searching with your eyes—you'll miss things that are actually there. You want power to be high (typically 0.800.80 or above).

Quick Example

A drug truly lowers blood pressure by 5 mmHg. With n=30n = 30 and α=0.05\alpha = 0.05, the power might be 0.650.65. This means there's a 65%65\% chance the study will detect the effect and a 35%35\% chance it will miss it. Increase to n=100:power0.95\text{Increase to } n = 100: \text{power} \approx 0.95

Notation

Power =1β= 1 - \beta. β=P(Type II error)\beta = P(\text{Type II error}).

What This Formula Means

The probability that a hypothesis test correctly rejects a false null hypothesis. Power =P(reject H0H0 is false)=1β= P(\text{reject } H_0 \mid H_0 \text{ is false}) = 1 - \beta, where β\beta is the probability of a Type II error.

Power is your test's ability to detect a real effect when one exists. A test with high power is like a sensitive metal detector—it won't miss a coin buried in the sand. A test with low power is like searching with your eyes—you'll miss things that are actually there. You want power to be high (typically 0.800.80 or above).

Formal View

Power=1β=P(reject H0Ha true)\text{Power} = 1 - \beta = P(\text{reject } H_0 \mid H_a \text{ true}) where β=P(Type II error)\beta = P(\text{Type II error})

Worked Examples

Example 1

medium
A test has α=0.05\alpha=0.05 and β=0.20\beta=0.20. Calculate the power and interpret it. If the researcher wants Power=0.90, what must β\beta become?

Answer

Power = 0.80. For Power=0.90, need β=0.10\beta=0.10 (achieved by increasing n).

First step

1
Power =1β=10.20=0.80= 1 - \beta = 1 - 0.20 = 0.80

See the full worked solution + why-it-works coaching

SetupKey insightWhy it worksCommon pitfallConnection

Unlock answer keys One Family plan — every worked solution, all subjects

Example 2

hard
For testing H0:μ=100H_0: \mu=100 vs Ha:μ=105H_a: \mu=105, with σ=10\sigma=10, n=25n=25, α=0.05\alpha=0.05: calculate the rejection region and power of the test.

Example 3

medium
For testing H0:μ=50H_0: \mu = 50 vs Ha:μ>50H_a: \mu > 50 with σ=8\sigma = 8 and n=64n = 64, find the rejection region for Xˉ\bar{X} at α=0.05\alpha = 0.05.

Common Mistakes

  • Confusing power with α\alpha - power conditions on H0H_0 being FALSE; α\alpha conditions on H0H_0 being TRUE.
  • Thinking power and β\beta add to nothing useful - power =1β=1-\beta, so a Type II error rate of 0.2 means power 0.8.
  • Believing a non-significant result proves no effect - a low-power test often misses real effects, so 'not significant' isn't 'no effect.'

Why This Formula Matters

A study with low power wastes effort: even a real effect probably comes back 'not significant,' so a non-rejection means little. Understanding that power rises with sample size, effect size, and a larger α\alpha is what lets researchers design studies that can actually find what they're looking for instead of failing by being underpowered. Recognizing it by "Am I asking for the probability of correctly rejecting the null GIVEN it is false (the detection rate)?" — rather than by familiar numbers — is what lets a student tell it apart from type ii error β\beta and significance level α\alpha and confidence level in a mixed problem set.

Frequently Asked Questions

What is the Power of a Test formula?

The probability that a hypothesis test correctly rejects a false null hypothesis. Power =P(reject H0H0 is false)=1β= P(\text{reject } H_0 \mid H_0 \text{ is false}) = 1 - \beta, where β\beta is the probability of a Type II error.

How do you use the Power of a Test formula?

Power is your test's ability to detect a real effect when one exists. A test with high power is like a sensitive metal detector—it won't miss a coin buried in the sand. A test with low power is like searching with your eyes—you'll miss things that are actually there. You want power to be high (typically 0.800.80 or above).

What do the symbols mean in the Power of a Test formula?

Power =1β= 1 - \beta. β=P(Type II error)\beta = P(\text{Type II error}).

Why is the Power of a Test formula important in Math?

A study with low power wastes effort: even a real effect probably comes back 'not significant,' so a non-rejection means little. Understanding that power rises with sample size, effect size, and a larger α\alpha is what lets researchers design studies that can actually find what they're looking for instead of failing by being underpowered. Recognizing it by "Am I asking for the probability of correctly rejecting the null GIVEN it is false (the detection rate)?" — rather than by familiar numbers — is what lets a student tell it apart from type ii error β\beta and significance level α\alpha and confidence level in a mixed problem set.

What do students get wrong about Power of a Test?

The procedure for power of a test is the easy part; the trap is confusing power with α\alpha. Asking "Am I asking for the probability of correctly rejecting the null GIVEN it is false (the detection rate)?" first is what keeps a correct-looking calculation from being attached to the wrong concept.

What should I learn before the Power of a Test formula?

Before studying the Power of a Test formula, you should understand: type i type ii errors, hypothesis testing, sampling distribution.