Example 1 — The skate shop survey
Show the steps and the answer
Sample result: say yes.
This is what the 50 people said; the question is whether it speaks for 12,000 residents.
Name the bias: a convenience sample with undercoverage, since people who never visit a skate shop had almost no chance of being asked.
The location decides who is included, so skaters and their friends are heavily over-represented.
Direction: the 90% is very likely too high.
People who skate are the most likely to want a skate park, and they are exactly the ones the method favored.
Fix: draw, say, 200 names at random from the town's list of residents and ask them.
A random draw from a full list gives every resident the same chance, removing the tilt.
Answer: The sample shows 90%, but it is a biased convenience sample that over-represents skaters, so support in the town is probably much lower; a random sample of residents would fix it.
Takeaway: Ask who the method made more likely to answer, and the direction of the bias usually follows.