Power of a Test Formula

Power of a test is the probability that a hypothesis test correctly rejects a false null hypothesis.

The Formula

Power=1−β=P(reject H0∣H0 is false)

Ask yourself: Am I asking for the probability of correctly rejecting the null GIVEN it is false (the detection rate)?

Quick example

A drug truly lowers blood pressure by 5 mmHg. With n=30 and α=0.05, the power might be 0.65. This means there's a 65% chance the study will detect the effect and a 35% chance it will miss it. Increase to n=100:power≈0.99

Notation

Power =1−β. β=P(Type II error).

What this formula means

The probability that a hypothesis test correctly rejects a false null hypothesis. Power =P(reject H0∣H0 is false)=1−β, where β is the probability of a Type II error.

Power works like a fishing net's chance of landing a fish that really is in the lake. A bigger fish (a larger effect) or a finer mesh (a larger sample) raises the catch rate. Unlike a net, a test can also 'catch' a fish that is not there; that false catch is α, a separate number.

Formal view

Power=1−β=P(reject H0∣Ha true) where β=P(Type II error)

Worked examples

Example 1

medium
A test has α=0.05 and β=0.20. Calculate the power and interpret it. If the researcher wants Power=0.90, what must β become?
Show solution

Answer

Power = 0.80. For Power=0.90, need β=0.10 (achieved by increasing n).

First step

1.
Power =1−β=1−0.20=0.80

See the full worked solution + why-it-works coaching

SetupKey insightWhy it worksCommon pitfallConnection

Free: full solutions on 3 topics a day. No card.

Every topic, every day: the Family plan

Example 2

hard
For testing H0:μ=100 vs Ha:μ=105, with σ=10, n=25, α=0.05: calculate the rejection region and power of the test.

Example 3

medium
For testing H0:μ=50 vs Ha:μ>50 with σ=8 and n=64, find the rejection region for Xˉ at α=0.05.

Common mistakes

  • Confusing power with α - power conditions on H0 being FALSE; α conditions on H0 being TRUE.
  • Thinking power and β add to nothing useful - power =1−β, so a Type II error rate of 0.2 means power 0.8.
  • Believing a non-significant result proves no effect - a low-power test often misses real effects, so 'not significant' isn't 'no effect.'

Why this formula matters

Power tells you whether a study could ever have found what it was looking for. With it you can choose a sample size before collecting any data, and you can read a 'not significant' result correctly: from a high-power study it suggests the effect is small or absent, but from a low-power study it says almost nothing. Ignoring power produces small studies that miss treatments that really work, followed by false claims of 'no effect'.

Frequently asked questions

What is the Power of a Test formula?

The probability that a hypothesis test correctly rejects a false null hypothesis. Power =P(reject H0∣H0 is false)=1−β, where β is the probability of a Type II error.

How do you use the Power of a Test formula?

Reach for power when the problem says the effect is real or the null is false and asks how likely the test is to detect it, or when it asks how large a sample a study needs. It also belongs in any discussion of a 'not significant' result. If the problem describes a true null and a wrong rejection, that is α; if it asks how often a real effect is missed, that is β; if it asks how often an interval captures a parameter, that is a confidence level.

What do the symbols mean in the Power of a Test formula?

Power =1−β. β=P(Type II error).

Why is the Power of a Test formula important in Math?

Power tells you whether a study could ever have found what it was looking for. With it you can choose a sample size before collecting any data, and you can read a 'not significant' result correctly: from a high-power study it suggests the effect is small or absent, but from a low-power study it says almost nothing. Ignoring power produces small studies that miss treatments that really work, followed by false claims of 'no effect'.

What do students get wrong about Power of a Test?

The procedure for power of a test is the easy part; the trap is confusing power with α. Asking "Am I asking for the probability of correctly rejecting the null GIVEN it is false (the detection rate)?" first is what keeps a correct-looking calculation from being attached to the wrong concept.

What should I learn before the Power of a Test formula?

Before studying the Power of a Test formula, you should understand: type i type ii errors, hypothesis testing, sampling distribution.