Observational vs Experimental Studies Statistics Example 3
Follow the full solution, then compare it with the other examples linked below.
Example 3
mediumA school wants to know if a new teaching method improves maths scores. Method 1: compare scores of students who chose the new method with those who chose the old method. Method 2: randomly assign students to each method. Which approach is better and why?
Solution
- 1 Step 1: Method 1 is observational (self-selection) — students who choose the new method might be more motivated, creating a confounding variable.
- 2 Step 2: Method 2 is experimental with random assignment — it controls for motivation and other confounders, allowing a causal conclusion about the teaching method.
Answer
Method 2 (random assignment) is better because it eliminates self-selection bias and confounding variables, enabling a causal conclusion about the teaching method's effectiveness.
Self-selection in observational studies introduces bias because the groups may differ in ways beyond the variable being studied. Random assignment creates comparable groups, so any difference in outcomes can be attributed to the treatment rather than pre-existing differences.
About Observational vs Experimental Studies
Observational studies gather data by watching subjects in their natural setting without any intervention, while experimental studies deliberately assign treatments to subjects and measure the outcomes. Only experiments, through random assignment, can establish cause-and-effect relationships.
Learn more about Observational vs Experimental Studies →More Observational vs Experimental Studies Examples
Example 1 easy
Classify each study as observational or experimental: (a) Researchers track the diets of 1000 people
Example 2 mediumA study finds that people who drink green tea have lower rates of heart disease. The study surveyed
Example 4 hardExplain why some research questions can only be studied observationally, not experimentally. Give tw