P-Value Formula
P-value is the probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis H_0 is true.
The Formula
Ask yourself: Am I computing the probability of data this extreme assuming the null is true (not the probability the null is true)?
Quick example
Notation
What this formula means
The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis is true.
A p-value is a surprise meter that assumes nothing special is going on. A friend says she is an average free-throw shooter, then sinks 20 shots in a row; you ask how often an average shooter would do that. The rarer that is under her story, the less you believe the story. The meter rates the data, not the story's probability.
Formal view
Worked examples
Example 1
mediumShow solution
Answer
First step
See the full worked solution + why-it-works coaching
SetupKey insightWhy it worksCommon pitfallConnection
Example 2
hardExample 3
easyCommon mistakes
- Reading the p-value as the probability the null hypothesis is true - it is the probability of the data given the null, not of the null given the data.
- Concluding is true when p is large - a large p-value means insufficient evidence to reject, never proof the null holds.
- Comparing the p-value to the wrong tail or forgetting two-sided - use for a two-sided test, doubling the one-tail area.
Why this formula matters
Most scientific claims you read, from "this drug lowers blood pressure" to "this teaching method helps," are backed by a p-value. Reading it correctly separates "these data would be surprising if the drug did nothing" from the common misreading "there's only a 3% chance the drug does nothing." That misreading inflates confidence in weak results and lies behind many headlines that later fail to replicate.
Frequently asked questions
What is the P-Value formula?
The probability of observing a test statistic at least as extreme as the one computed from the sample data, assuming the null hypothesis is true.
How do you use the P-Value formula?
Use a p-value after computing a test statistic (, or ) when you need to say how surprising the data are under , then compare it with . Count both tails for a two-sided () and one tail for or . If the question asks how likely itself is, a p-value can't answer it. If it asks for the long-run rate of rejecting a true null, that is , the Type I error rate.
What do the symbols mean in the P-Value formula?
If p-value , reject . If p-value , fail to reject .
Why is the P-Value formula important in Math?
Most scientific claims you read, from "this drug lowers blood pressure" to "this teaching method helps," are backed by a p-value. Reading it correctly separates "these data would be surprising if the drug did nothing" from the common misreading "there's only a 3% chance the drug does nothing." That misreading inflates confidence in weak results and lies behind many headlines that later fail to replicate.
What do students get wrong about P-Value?
The procedure for p-value is the easy part; the trap is reading the p-value as the probability the null hypothesis is true. Asking "Am I computing the probability of data this extreme assuming the null is true (not the probability the null is true)?" first is what keeps a correct-looking calculation from being attached to the wrong concept.
What should I learn before the P-Value formula?
Before studying the P-Value formula, you should understand: hypothesis testing, probability.