Hypothesis Testing

Statistics
process

Also known as: significance testing, statistical test

Grade 9-12

View on concept map

A systematic method to decide whether sample data provides enough evidence to reject a claim (null hypothesis) about a population parameter. Hypothesis testing is how science decides if results are 'real.

Definition

A systematic method to decide whether sample data provides enough evidence to reject a claim (null hypothesis) about a population parameter.

💡 Intuition

Think of a courtroom trial: the null hypothesis (H_0) is 'innocent until proven guilty.' You look at the evidence (data) and ask: 'Is this evidence so strong that it would be very unlikely if the defendant were truly innocent?' If yes, you reject the null hypothesis. If not, you don't have enough evidence to convict—but that doesn't prove innocence.

🎯 Core Idea

Hypothesis testing follows a fixed procedure: (1) state H_0 and H_a, (2) choose significance level \alpha, (3) compute the test statistic, (4) find the p-value, (5) reject H_0 if p-value < \alpha, otherwise fail to reject.

Example

A company claims batteries last \mu = 500 hours. You test 36 batteries and get \bar{x} = 485, s = 40. z = \frac{485 - 500}{40 / \sqrt{36}} = \frac{-15}{6.67} \approx -2.25 Since |z| > 1.96, reject H_0 at \alpha = 0.05—evidence suggests batteries last less than claimed.

Formula

z = \frac{\bar{x} - \mu_0}{\sigma / \sqrt{n}}

Notation

H_0: null hypothesis (the default claim). H_a: alternative hypothesis (what we suspect). \alpha: significance level (typically 0.05).

🌟 Why It Matters

Hypothesis testing is how science decides if results are 'real.' Drug trials, A/B tests, quality control, and research studies all rely on it to distinguish genuine effects from random noise.

Formal View

z = \frac{\bar{x} - \mu_0}{\sigma / \sqrt{n}}; reject H_0 if |z| > z_{\alpha/2} (two-tailed) or equivalently if p-value < \alpha

🚧 Common Stuck Point

'Fail to reject H_0' does NOT mean 'H_0 is true'—it means there's not enough evidence against it. Absence of evidence is not evidence of absence.

⚠️ Common Mistakes

  • Saying 'accept H_0' instead of 'fail to reject H_0'—we never prove the null hypothesis, we only fail to find evidence against it.
  • Choosing \alpha after seeing the data (p-hacking)—the significance level must be set before collecting data.
  • Confusing statistical significance with practical significance—a statistically significant result may be too small to matter in practice.

Frequently Asked Questions

What is Hypothesis Testing in Math?

A systematic method to decide whether sample data provides enough evidence to reject a claim (null hypothesis) about a population parameter.

Why is Hypothesis Testing important?

Hypothesis testing is how science decides if results are 'real.' Drug trials, A/B tests, quality control, and research studies all rely on it to distinguish genuine effects from random noise.

What do students usually get wrong about Hypothesis Testing?

'Fail to reject H_0' does NOT mean 'H_0 is true'—it means there's not enough evidence against it. Absence of evidence is not evidence of absence.

What should I learn before Hypothesis Testing?

Before studying Hypothesis Testing, you should understand: sampling distribution, normal distribution, probability.

How Hypothesis Testing Connects to Other Ideas

To understand hypothesis testing, you should first be comfortable with sampling distribution, normal distribution and probability. Once you have a solid grasp of hypothesis testing, you can move on to p value and type i type ii errors.

← Back to Explorer