P-Value Formula

P-value is the probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is.

The Formula

p-value=P(∣Z∣≥∣zobs∣∣H0 true)\text{p-value} = P(|Z| \geq |z_{\text{obs}}| \mid H_0 \text{ true})

When to use: The p-value answers: 'If nothing special is going on (H0H_0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H0H_0, so maybe H0H_0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)—so you'd conclude the coin is probably not fair.

Quick Example

Test statistic z=2.4z = 2.4 for a two-tailed test. p-value=2×P(Z>2.4)=2×0.0082=0.0164\text{p-value} = 2 \times P(Z > 2.4) = 2 \times 0.0082 = 0.0164 Since 0.0164<0.05=α0.0164 < 0.05 = \alpha, reject H0H_0.

Notation

If p-value <α< \alpha, reject H0H_0. If p-value ≥α\geq \alpha, fail to reject H0H_0.

What This Formula Means

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H0H_0 is true.

The p-value answers: 'If nothing special is going on (H0H_0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H0H_0, so maybe H0H_0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)—so you'd conclude the coin is probably not fair.

Formal View

p-value=P(∣Z∣≥∣zobs∣∣H0)\text{p-value} = P(|Z| \geq |z_{\text{obs}}| \mid H_0) (two-tailed); reject H0H_0 when p-value <α< \alpha

Worked Examples

Example 1

medium
A hypothesis test produces z=2.3z=2.3 for a two-tailed test. Calculate the p-value and interpret it at both α=0.05\alpha=0.05 and α=0.01\alpha=0.01.

Answer

p=0.0214p=0.0214. Significant at α=0.05\alpha=0.05 but not at α=0.01\alpha=0.01.

First step

1
Two-tailed p-value: p=2×P(Z>2.3)=2×(1−0.9893)=2×0.0107=0.0214p = 2 \times P(Z > 2.3) = 2 \times (1 - 0.9893) = 2 \times 0.0107 = 0.0214

See the full worked solution + why-it-works coaching

SetupKey insightWhy it worksCommon pitfallConnection

Unlock answer keys One Family plan — every worked solution, all subjects

Example 2

hard
Correct the following misconceptions about p-values: (a) 'p=0.03 means there's a 3% chance H₀ is true.' (b) 'p=0.03 means the effect is large.'

Example 3

easy
A right-tailed test produces z=0.5z = 0.5. Use P(Z>0.5)=0.3085P(Z > 0.5) = 0.3085 to find the p-value and decide at α=0.05\alpha = 0.05.

Common Mistakes

  • Reading the p-value as the probability the null hypothesis is true - it is the probability of the data given the null, not of the null given the data.
  • Concluding H0H_0 is true when p is large - a large p-value means insufficient evidence to reject, never proof the null holds.
  • Comparing the p-value to the wrong tail or forgetting two-sided - use ∣Z∣≥∣zobs∣|Z| \geq |z_{\text{obs}}| for a two-sided test, doubling the one-tail area.

Why This Formula Matters

The p-value is the single number that turns 'my sample looks different' into a defensible reject/fail-to-reject decision. Students who read it backward — as the probability the null is true — draw wrong conclusions from correct arithmetic, which is the most common inference error in all of intro statistics. Recognizing it by "Am I computing the probability of data this extreme assuming the null is true (not the probability the null is true)?" — rather than by familiar numbers — is what lets a student tell it apart from significance level α\alpha and confidence level and type i error rate in a mixed problem set.

Frequently Asked Questions

What is the P-Value formula?

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H0H_0 is true.

How do you use the P-Value formula?

The p-value answers: 'If nothing special is going on (H0H_0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H0H_0, so maybe H0H_0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)—so you'd conclude the coin is probably not fair.

What do the symbols mean in the P-Value formula?

If p-value <α< \alpha, reject H0H_0. If p-value ≥α\geq \alpha, fail to reject H0H_0.

Why is the P-Value formula important in Math?

The p-value is the single number that turns 'my sample looks different' into a defensible reject/fail-to-reject decision. Students who read it backward — as the probability the null is true — draw wrong conclusions from correct arithmetic, which is the most common inference error in all of intro statistics. Recognizing it by "Am I computing the probability of data this extreme assuming the null is true (not the probability the null is true)?" — rather than by familiar numbers — is what lets a student tell it apart from significance level α\alpha and confidence level and type i error rate in a mixed problem set.

What do students get wrong about P-Value?

The procedure for p-value is the easy part; the trap is reading the p-value as the probability the null hypothesis is true. Asking "Am I computing the probability of data this extreme assuming the null is true (not the probability the null is true)?" first is what keeps a correct-looking calculation from being attached to the wrong concept.

What should I learn before the P-Value formula?

Before studying the P-Value formula, you should understand: hypothesis testing, probability.

← Back to P-Value See All Examples Practice Problems