Power of a Test Formula

The Formula

\text{Power} = 1 - \beta = P(\text{reject } H_0 \mid H_0 \text{ is false})

When to use: Power is your test's ability to detect a real effect when one exists. A test with high power is like a sensitive metal detector—it won't miss a coin buried in the sand. A test with low power is like searching with your eyes—you'll miss things that are actually there. You want power to be high (typically 0.80 or above).

Quick Example

A drug truly lowers blood pressure by 5 mmHg. With n = 30 and \alpha = 0.05, the power might be 0.65. This means there's a 65\% chance the study will detect the effect and a 35\% chance it will miss it. \text{Increase to } n = 100: \text{power} \approx 0.95

Notation

Power = 1 - \beta. \beta = P(\text{Type II error}).

What This Formula Means

The probability that a hypothesis test correctly rejects a false null hypothesis. Power = P(\text{reject } H_0 \mid H_0 \text{ is false}) = 1 - \beta, where \beta is the probability of a Type II error.

Power is your test's ability to detect a real effect when one exists. A test with high power is like a sensitive metal detector—it won't miss a coin buried in the sand. A test with low power is like searching with your eyes—you'll miss things that are actually there. You want power to be high (typically 0.80 or above).

Formal View

\text{Power} = 1 - \beta = P(\text{reject } H_0 \mid H_a \text{ true}) where \beta = P(\text{Type II error})

Worked Examples

Example 1

medium
A test has \alpha=0.05 and \beta=0.20. Calculate the power and interpret it. If the researcher wants Power=0.90, what must \beta become?

Solution

  1. 1
    Power = 1 - \beta = 1 - 0.20 = 0.80
  2. 2
    Interpretation: if the alternative hypothesis is true, there is an 80% probability of correctly rejecting H_0
  3. 3
    For Power=0.90: \beta = 1 - 0.90 = 0.10; reduce Type II error from 0.20 to 0.10
  4. 4
    Achieving this: increase sample size (most effective way to increase power without changing \alpha)

Answer

Power = 0.80. For Power=0.90, need \beta=0.10 (achieved by increasing n).
Power = P(reject H₀ | H₀ is false) = 1 - β. Higher power means better ability to detect real effects. Increasing sample size is the primary way to increase power while holding α constant. Power depends on: α, effect size, sample size, and population variability.

Example 2

hard
For testing H_0: \mu=100 vs H_a: \mu=105, with \sigma=10, n=25, \alpha=0.05: calculate the rejection region and power of the test.

Common Mistakes

  • Thinking power is the probability that H_0 is false—power is the probability of detecting a false H_0, which assumes H_0 IS false.
  • Forgetting that power depends on the true parameter value—you need to specify an alternative to compute power.
  • Believing you can increase power without trade-offs—increasing \alpha raises power but also raises the Type I error rate. Only increasing n improves power without a downside.

Why This Formula Matters

Before conducting a study, researchers perform a power analysis to determine how large a sample they need. A study with low power is a waste of resources—it's unlikely to find the effect even if it's real.

Frequently Asked Questions

What is the Power of a Test formula?

The probability that a hypothesis test correctly rejects a false null hypothesis. Power = P(\text{reject } H_0 \mid H_0 \text{ is false}) = 1 - \beta, where \beta is the probability of a Type II error.

How do you use the Power of a Test formula?

Power is your test's ability to detect a real effect when one exists. A test with high power is like a sensitive metal detector—it won't miss a coin buried in the sand. A test with low power is like searching with your eyes—you'll miss things that are actually there. You want power to be high (typically 0.80 or above).

What do the symbols mean in the Power of a Test formula?

Power = 1 - \beta. \beta = P(\text{Type II error}).

Why is the Power of a Test formula important in Math?

Before conducting a study, researchers perform a power analysis to determine how large a sample they need. A study with low power is a waste of resources—it's unlikely to find the effect even if it's real.

What do students get wrong about Power of a Test?

Students confuse power with the p-value. Power is calculated BEFORE the study (planning stage) and depends on the true effect size. The p-value is calculated AFTER data collection.

What should I learn before the Power of a Test formula?

Before studying the Power of a Test formula, you should understand: type i type ii errors, hypothesis testing, sampling distribution.

← Back to Power of a Test See All Examples Practice Problems