Example 1 — New study method
EasyProblem
After a new method, one student's score rises from 82 to 85, while their week-to-week scores normally swing . Real improvement?
Solution
-
The 3-point gain must be compared to the normal fluctuation.
Name the structure before touching arithmetic — that is what makes the right method obvious.
-
Ask the recognition question: Is the difference larger than the data's ordinary random fluctuation?
If the answer is yes, the concept applies; the cue, not a keyword, decides the method.
-
Check whether the change exceeds the ordinary noise band.
The rule is chosen only after the structure matches, so the steps mean something.
-
A 3-point rise sits inside the usual swing, so it cannot be distinguished from noise.
Keep units, shape, or answer form tied to the story so the work does not become symbol pushing.
-
Check the answer against the original question.
It should fit the mental model — is this pattern real or just luck. If it does not, revisit the recognition step before changing the arithmetic.
Answer
Not yet a signal — could be noise
Takeaway: An effect smaller than the normal wiggle can't be called real.