P-Value

Statistics
definition

Also known as: probability value, observed significance level

Grade 9-12

View on concept map

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true. P-values are the most widely used measure of statistical evidence in science, medicine, and business.

Definition

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true.

💡 Intuition

The p-value answers: 'If nothing special is going on (H_0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H_0, so maybe H_0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)—so you'd conclude the coin is probably not fair.

🎯 Core Idea

The p-value measures the strength of evidence against H_0: smaller p-value = stronger evidence against the null hypothesis. It is NOT the probability that H_0 is true.

Example

Test statistic z = 2.4 for a two-tailed test. \text{p-value} = 2 \times P(Z > 2.4) = 2 \times 0.0082 = 0.0164 Since 0.0164 < 0.05 = \alpha, reject H_0.

Formula

\text{p-value} = P(|Z| \geq |z_{\text{obs}}| \mid H_0 \text{ true})

Notation

If p-value < \alpha, reject H_0. If p-value \geq \alpha, fail to reject H_0.

🌟 Why It Matters

P-values are the most widely used measure of statistical evidence in science, medicine, and business. Understanding what they actually mean (and don't mean) is critical for interpreting research correctly.

💭 Hint When Stuck

The p-value answers: 'If the null hypothesis were true, how surprising is my data?' A small p-value (below your threshold) means the data is very unlikely under the null, so you reject it.

Formal View

\text{p-value} = P(|Z| \geq |z_{\text{obs}}| \mid H_0) (two-tailed); reject H_0 when p-value < \alpha

🚧 Common Stuck Point

A p-value of 0.03 does NOT mean 'there's a 3\% chance H_0 is true.' It means 'if H_0 were true, there's a 3\% chance of seeing data this extreme.'

⚠️ Common Mistakes

  • Interpreting the p-value as the probability that the null hypothesis is true—it's a probability about the data given H_0, not about H_0 given the data.
  • Treating p = 0.049 as fundamentally different from p = 0.051—the \alpha = 0.05 threshold is a convention, not a magic boundary.
  • Believing a large p-value proves H_0 is true—it only means the data are consistent with H_0, not that H_0 is correct.

Frequently Asked Questions

What is P-Value in Math?

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true.

What is the P-Value formula?

\text{p-value} = P(|Z| \geq |z_{\text{obs}}| \mid H_0 \text{ true})

When do you use P-Value?

The p-value answers: 'If the null hypothesis were true, how surprising is my data?' A small p-value (below your threshold) means the data is very unlikely under the null, so you reject it.

How P-Value Connects to Other Ideas

To understand p-value, you should first be comfortable with hypothesis testing and probability. Once you have a solid grasp of p-value, you can move on to type i type ii errors.

← Back to Explorer