P-Value Formula

The Formula

\text{p-value} = P(|Z| \geq |z_{\text{obs}}| \mid H_0 \text{ true})

When to use: The p-value answers: 'If nothing special is going on (H_0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H_0, so maybe H_0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)β€”so you'd conclude the coin is probably not fair.

Quick Example

Test statistic z = 2.4 for a two-tailed test. \text{p-value} = 2 \times P(Z > 2.4) = 2 \times 0.0082 = 0.0164 Since 0.0164 < 0.05 = \alpha, reject H_0.

Notation

If p-value < \alpha, reject H_0. If p-value \geq \alpha, fail to reject H_0.

What This Formula Means

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true.

The p-value answers: 'If nothing special is going on (H_0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H_0, so maybe H_0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)β€”so you'd conclude the coin is probably not fair.

Formal View

\text{p-value} = P(|Z| \geq |z_{\text{obs}}| \mid H_0) (two-tailed); reject H_0 when p-value < \alpha

Worked Examples

Example 1

medium
A hypothesis test produces z=2.3 for a two-tailed test. Calculate the p-value and interpret it at both \alpha=0.05 and \alpha=0.01.

Solution

  1. 1
    Two-tailed p-value: p = 2 \times P(Z > 2.3) = 2 \times (1 - 0.9893) = 2 \times 0.0107 = 0.0214
  2. 2
    At \alpha=0.05: p=0.0214 < 0.05 β†’ Reject H_0 (result is statistically significant)
  3. 3
    At \alpha=0.01: p=0.0214 > 0.01 β†’ Fail to reject H_0 (result is not significant at 1% level)
  4. 4
    Interpretation: there's a 2.14% probability of getting a test statistic at least as extreme as 2.3 if H_0 is true

Answer

p=0.0214. Significant at \alpha=0.05 but not at \alpha=0.01.
The p-value is the probability of obtaining evidence as extreme or more extreme than observed, assuming Hβ‚€ is true. Small p-values (< Ξ±) indicate data is unlikely under Hβ‚€. The same p-value can lead to different conclusions depending on the chosen significance level.

Example 2

hard
Correct the following misconceptions about p-values: (a) 'p=0.03 means there's a 3% chance Hβ‚€ is true.' (b) 'p=0.03 means the effect is large.'

Common Mistakes

  • Interpreting the p-value as the probability that the null hypothesis is trueβ€”it's a probability about the data given H_0, not about H_0 given the data.
  • Treating p = 0.049 as fundamentally different from p = 0.051β€”the \alpha = 0.05 threshold is a convention, not a magic boundary.
  • Believing a large p-value proves H_0 is trueβ€”it only means the data are consistent with H_0, not that H_0 is correct.

Why This Formula Matters

P-values are the most widely used measure of statistical evidence in science, medicine, and business. Understanding what they actually mean (and don't mean) is critical for interpreting research correctly.

Frequently Asked Questions

What is the P-Value formula?

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true.

How do you use the P-Value formula?

The p-value answers: 'If nothing special is going on (H_0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H_0, so maybe H_0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)β€”so you'd conclude the coin is probably not fair.

What do the symbols mean in the P-Value formula?

If p-value < \alpha, reject H_0. If p-value \geq \alpha, fail to reject H_0.

Why is the P-Value formula important in Math?

P-values are the most widely used measure of statistical evidence in science, medicine, and business. Understanding what they actually mean (and don't mean) is critical for interpreting research correctly.

What do students get wrong about P-Value?

A p-value of 0.03 does NOT mean 'there's a 3\% chance H_0 is true.' It means 'if H_0 were true, there's a 3\% chance of seeing data this extreme.'

What should I learn before the P-Value formula?

Before studying the P-Value formula, you should understand: hypothesis testing, probability.

← Back to P-Value See All Examples Practice Problems