Signal vs Noise Math Example 2

Follow the full solution, then compare it with the other examples linked below.

Example 2

medium
A polling company surveys 100 people monthly. In January, 48% support Policy X. In February, 51%. Explain whether this 3% change is signal or noise, using standard error.

Solution

  1. 1
    Standard error of a proportion: SE=p(1โˆ’p)n=0.5ร—0.5100=0.05=5%SE = \sqrt{\frac{p(1-p)}{n}} = \sqrt{\frac{0.5 \times 0.5}{100}} = 0.05 = 5\%
  2. 2
    The observed change is 3%, which is less than one standard error (5%)
  3. 3
    A change smaller than the typical random fluctuation could easily occur by chance
  4. 4
    Conclusion: the 3% shift is noise โ€” within the margin of sampling error; we cannot conclude genuine opinion change

Answer

The 3% change (< 1 SE = 5%) is noise; it falls within expected random variation from sampling.
Statistical significance distinguishes signal from noise. When an observed change is smaller than the standard error, it could easily arise from sampling randomness alone. Larger samples reduce noise, making real signals easier to detect.

About Signal vs Noise

Signal versus noise describes the fundamental challenge of separating meaningful patterns (signal) from random, unpredictable variation (noise) in data โ€” the central task of all statistical analysis.

Learn more about Signal vs Noise โ†’

More Signal vs Noise Examples