Law of Large Numbers (Intuition) Formula

Q: What do the symbols mean in the Law of Large Numbers (Intuition) formula?

$\bar{X}_n$ is the sample mean after $n$ trials; $\mu$ is the true population mean

The Formula

\bar{X}_n \to \mu \text{ as } n \to \infty

When to use: As the number of trials grows, the sample mean converges to the true expected value — randomness averages out over many trials, making the average predictable.

Quick Example

Flip 10 coins: might get 70\% heads. Flip 10,000: will get close to 50\%.

Notation

\bar{X}_n is the sample mean after n trials; \mu is the true population mean

What This Formula Means

As sample size increases, the sample average approaches the true population average.

As the number of trials grows, the sample mean converges to the true expected value — randomness averages out over many trials, making the average predictable.

Formal View

\bar{X}_n \xrightarrow{P} \mu as n \to \infty; i.e., for any \varepsilon > 0, P(|\bar{X}_n - \mu| > \varepsilon) \to 0

Worked Examples

Example 1

easy

A fair coin is flipped. Show how the proportion of heads approaches 0.5 as n increases, using simulation results: n=10: 6 heads; n=100: 53 heads; n=1000: 498 heads.

Solution

1
n=10: proportion = 6/10 = 0.60 (60% — far from 0.5)
2
n=100: proportion = 53/100 = 0.53 (53% — closer to 0.5)
3
n=1000: proportion = 498/1000 = 0.498 (49.8% — very close to 0.5)
4
Pattern: as n increases, \bar{X} \to 0.5 = \mu, illustrating the Law of Large Numbers

Answer

Proportions: 0.60, 0.53, 0.498 — converging to 0.5 as n grows.

The Law of Large Numbers states that as sample size n \to \infty, the sample mean \bar{X} converges to the true population mean \mu. Small samples can show large deviations from the truth; large samples reliably estimate it.

Example 2

medium

A casino game has expected value -\0.05$ per play (house edge). A player plays 10 games vs. 10,000 games. Explain how the LLN affects the likely outcome in each case.

Common Mistakes

Believing the law of large numbers means outcomes must 'balance out' in the short run — it only applies as sample size approaches infinity
Applying the law to a single trial or small sample — it describes long-run behavior, not short-run guarantees
Confusing the law of large numbers with the gambler's fallacy — past outcomes do not influence future independent trials

Why This Formula Matters

Foundation for why statistics works: large samples are reliable.

Frequently Asked Questions

What is the Law of Large Numbers (Intuition) formula?

As sample size increases, the sample average approaches the true population average.

How do you use the Law of Large Numbers (Intuition) formula?

As the number of trials grows, the sample mean converges to the true expected value — randomness averages out over many trials, making the average predictable.