P-Value Formula

P-value is the probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true.

The Formula

p-value=P(∣Z∣≥∣zobs∣∣H0 true)

When to use: The p-value answers: 'If nothing special is going on (H0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H0, so maybe H0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)—so you'd conclude the coin is probably not fair.

Quick Example

Test statistic z=2.4 for a two-tailed test. p-value=2×P(Z>2.4)=2×0.0082=0.0164 Since 0.0164<0.05=α, reject H0.

Notation

If p-value <α, reject H0. If p-value ≥α, fail to reject H0.

What This Formula Means

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H0 is true.

The p-value answers: 'If nothing special is going on (H0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H0, so maybe H0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)—so you'd conclude the coin is probably not fair.

Formal View

p-value=P(∣Z∣≥∣zobs∣∣H0) (two-tailed); reject H0 when p-value <α

Worked Examples

Example 1

medium
A hypothesis test produces z=2.3 for a two-tailed test. Calculate the p-value and interpret it at both α=0.05 and α=0.01.

Answer

p=0.0214. Significant at α=0.05 but not at α=0.01.

First step

1
Two-tailed p-value: p=2×P(Z>2.3)=2×(1−0.9893)=2×0.0107=0.0214

See the full worked solution + why-it-works coaching

SetupKey insightWhy it worksCommon pitfallConnection

Unlock answer keys One Family plan — every worked solution, all subjects

Example 2

hard
Correct the following misconceptions about p-values: (a) 'p=0.03 means there's a 3% chance H₀ is true.' (b) 'p=0.03 means the effect is large.'

Example 3

easy
A right-tailed test produces z=0.5. Use P(Z>0.5)=0.3085 to find the p-value and decide at α=0.05.

Common Mistakes

  • Reading the p-value as the probability the null hypothesis is true - it is the probability of the data given the null, not of the null given the data.
  • Concluding H0 is true when p is large - a large p-value means insufficient evidence to reject, never proof the null holds.
  • Comparing the p-value to the wrong tail or forgetting two-sided - use ∣Z∣≥∣zobs∣ for a two-sided test, doubling the one-tail area.

Why This Formula Matters

The p-value is the single number that turns 'my sample looks different' into a defensible reject/fail-to-reject decision. Students who read it backward — as the probability the null is true — draw wrong conclusions from correct arithmetic, which is the most common inference error in all of intro statistics. Recognizing it by "Am I computing the probability of data this extreme assuming the null is true (not the probability the null is true)?" — rather than by familiar numbers — is what lets a student tell it apart from significance level α and confidence level and type i error rate in a mixed problem set.

Frequently Asked Questions

What is the P-Value formula?

The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H0 is true.

How do you use the P-Value formula?

The p-value answers: 'If nothing special is going on (H0 is true), how surprising is my data?' A tiny p-value means the data would be very rare under H0, so maybe H0 is wrong. Think of it like this: you flip a coin 100 times and get 92 heads. If the coin is fair, the chance of that happening is astronomically small (tiny p-value)—so you'd conclude the coin is probably not fair.

What do the symbols mean in the P-Value formula?

If p-value <α, reject H0. If p-value ≥α, fail to reject H0.

Why is the P-Value formula important in Math?

The p-value is the single number that turns 'my sample looks different' into a defensible reject/fail-to-reject decision. Students who read it backward — as the probability the null is true — draw wrong conclusions from correct arithmetic, which is the most common inference error in all of intro statistics. Recognizing it by "Am I computing the probability of data this extreme assuming the null is true (not the probability the null is true)?" — rather than by familiar numbers — is what lets a student tell it apart from significance level α and confidence level and type i error rate in a mixed problem set.

What do students get wrong about P-Value?

The procedure for p-value is the easy part; the trap is reading the p-value as the probability the null hypothesis is true. Asking "Am I computing the probability of data this extreme assuming the null is true (not the probability the null is true)?" first is what keeps a correct-looking calculation from being attached to the wrong concept.

What should I learn before the P-Value formula?

Before studying the P-Value formula, you should understand: hypothesis testing, probability.