P-Value

Statistics
definition

Also known as: probability value, observed significance level

Grade 9-12

View on concept map

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true. P-values are the most widely used measure of statistical evidence in science, medicine, and business.

Definition

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true.

💡 Intuition

The p-value answers: 'If nothing special is going on (H_0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H_0, so maybe H_0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)—so you'd conclude the coin is probably not fair.

🎯 Core Idea

The p-value measures the strength of evidence against H_0: smaller p-value = stronger evidence against the null hypothesis. It is NOT the probability that H_0 is true.

Example

Test statistic z = 2.4 for a two-tailed test. \text{p-value} = 2 \times P(Z > 2.4) = 2 \times 0.0082 = 0.0164 Since 0.0164 < 0.05 = \alpha, reject H_0.

Formula

\text{p-value} = P(|Z| \geq |z_{\text{obs}}| \mid H_0 \text{ true})

Notation

If p-value < \alpha, reject H_0. If p-value \geq \alpha, fail to reject H_0.

🌟 Why It Matters

P-values are the most widely used measure of statistical evidence in science, medicine, and business. Understanding what they actually mean (and don't mean) is critical for interpreting research correctly.

Formal View

\text{p-value} = P(|Z| \geq |z_{\text{obs}}| \mid H_0) (two-tailed); reject H_0 when p-value < \alpha

See Also

z score

🚧 Common Stuck Point

A p-value of 0.03 does NOT mean 'there's a 3\% chance H_0 is true.' It means 'if H_0 were true, there's a 3\% chance of seeing data this extreme.'

⚠️ Common Mistakes

  • Interpreting the p-value as the probability that the null hypothesis is true—it's a probability about the data given H_0, not about H_0 given the data.
  • Treating p = 0.049 as fundamentally different from p = 0.051—the \alpha = 0.05 threshold is a convention, not a magic boundary.
  • Believing a large p-value proves H_0 is true—it only means the data are consistent with H_0, not that H_0 is correct.

Frequently Asked Questions

What is P-Value in Math?

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true.

Why is P-Value important?

P-values are the most widely used measure of statistical evidence in science, medicine, and business. Understanding what they actually mean (and don't mean) is critical for interpreting research correctly.

What do students usually get wrong about P-Value?

A p-value of 0.03 does NOT mean 'there's a 3\% chance H_0 is true.' It means 'if H_0 were true, there's a 3\% chance of seeing data this extreme.'

What should I learn before P-Value?

Before studying P-Value, you should understand: hypothesis testing, probability.

How P-Value Connects to Other Ideas

To understand p-value, you should first be comfortable with hypothesis testing and probability. Once you have a solid grasp of p-value, you can move on to type i type ii errors.

← Back to Explorer