Common Mistakes in Statistics

The statistics mistakes students make most often are reading a correlation as proof of cause, using the mean on strongly skewed data where the median fits better, and confusing P(A | B) with P(B | A). Below are 20 common mistakes grouped by topic, each with how to fix it.

Mean vs Median

  1. Using the mean automatically even when the data are strongly skewed

    The mean is pulled by extreme values. When a distribution is skewed, the median often gives a better description of a typical value.

  2. Thinking the median is just the “middle-looking” number without ordering the data

    The median is defined after the values are put in order. If the data are not ordered, the chosen value is not the median.

  3. Ignoring outliers before choosing a measure of center

    One very large or very small value can change the mean a lot while barely moving the median.

  4. Treating mean and median as interchangeable because both are called averages

    They answer slightly different questions. The mean balances the data; the median splits the ordered data into two equal halves.

  5. Choosing a center without checking the shape of the distribution

    Always look at the graph or ordered list first. Shape, symmetry, and outliers tell you which summary is more trustworthy.

Mean vs Median mistakes in detail

Sampling Bias

  1. Treating a convenient sample as if it represents the whole population

    Easy-to-reach people are not automatically representative. Convenience sampling often overrepresents one group and misses another.

  2. Forgetting that who does not respond can matter as much as who does

    Nonresponse can bias results if the people who skip the survey differ in an important way from those who answer it.

  3. Assuming “large sample” means “unbiased sample”

    A large biased sample is still biased. Sample size reduces random variability, not bad selection methods.

  4. Generalizing from one class, school, or website to a much broader population

    Check whether the sample frame matches the population you want to make claims about.

  5. Ignoring wording or measurement choices that push responses in one direction

    Bias can enter through the question itself, not only through who gets selected.

Sampling Bias mistakes in detail

Correlation vs Causation

  1. Assuming that if two variables move together, one must cause the other

    Association alone does not identify cause. A third variable or a hidden process could explain the pattern.

  2. Ignoring confounding variables

    A confounder is related to both variables and can create the appearance of a direct causal link when none exists.

  3. Using observational data to make a strong causal claim

    Observational studies are useful, but strong causal claims usually require well-designed experiments with random assignment.

  4. Reading a scatter plot as proof instead of evidence to investigate

    A scatter plot can suggest direction and strength of association, but it does not establish mechanism.

  5. Forgetting that causation usually needs a study design argument, not just a numerical one

    Ask how the data were collected before deciding what kind of conclusion is justified.

Correlation vs Causation mistakes in detail

Conditional Probability

  1. Keeping the original denominator after the condition changes the sample space

    In P(A | B), the condition B becomes the new universe. The denominator must describe the cases where B happens.

  2. Confusing P(A | B) with P(B | A)

    Reversing the condition changes the meaning. These probabilities can be very different even when the same two events are involved.

  3. Assuming conditional probability means the events are independent

    Independence is a special case where conditioning does not change the probability. Most conditional questions involve dependence.

  4. Reading the wrong row or column in a two-way table

    Mark the conditioned group first, then compute the proportion within that group only.

  5. Using multiplication rules without checking whether the events depend on each other

    If the first event changes the chance of the second, you need a conditional probability in the multiplication rule.

Conditional Probability mistakes in detail

Mistakes From Every Lesson, by Topic

Every statistics lesson lists the mistakes students make with that idea. These pages collect them by topic, each linked to the lesson that explains the right idea.

Why These Mistakes Happen

Statistics mistakes usually happen when a summary, graph or probability is asked to support a claim it cannot support. The calculation can be right and the conclusion still wrong, so most fixes below are about what a result allows you to say.