Model Fit (Intuition) Examples in Math

Start with the recap, study the fully worked examples, then use the practice problems to check your understanding of Model Fit (Intuition).

This page combines explanation, solved examples, and follow-up practice so you can move from recognition to confident problem-solving in Math.

Concept Recap

Model fit describes how closely a statistical model's predictions match the observed data — measured by residuals, R^2, or loss functions.

Does the model's predictions match reality? Good fit = close match.

Read the full concept explanation →

How to Use These Examples

  • Read the first worked example with the solution open so the structure is clear.
  • Try the practice problems before revealing each solution.
  • Use the related concepts and background knowledge badges if you feel stuck.

What to Focus On

Core idea: Perfect fit on training data isn't the goal—good fit on NEW data is.

Common stuck point: More complex models fit better but may not predict better (overfitting).

Sense of Study hint: Plot the residuals (actual minus predicted). If they scatter randomly, your model fits well. If you see a pattern, the model is missing something.

Worked Examples

Example 1

easy
A scatter plot of weight vs. height shows points loosely scattered around a line. Two measures of fit are given: R^2 = 0.65 and residuals with SD = 8 kg. Interpret both measures.

Solution

  1. 1
    R^2 = 0.65: the linear model explains 65% of the variability in weight — moderate fit
  2. 2
    Residual SD = 8 kg: typical prediction error is ±8 kg — individual predictions could be 8 kg off on average
  3. 3
    Combining: the model captures most weight variation but not all; 35% of variation remains unexplained
  4. 4
    Assessment: moderate fit — useful for general trends, but not precise enough for individual weight prediction

Answer

R^2=0.65 means 65% explained; residual SD=8 kg means typical error is ±8 kg. Moderate fit.
Model fit has two complementary measures: R^2 (proportion of variation explained) and residual SD (typical prediction error in original units). Both are needed: high R^2 with large residual SD can still mean poor practical predictions.

Example 2

medium
Residual plot for a linear model shows a clear U-shaped pattern. What does this indicate about the model, and what should be done?

Practice Problems

Try these problems on your own first, then open the solution to compare your method.

Example 1

easy
Three models have R^2 values: Model A = 0.95, Model B = 0.50, Model C = 0.10. Rank them by goodness of fit and describe what each R^2 means.

Example 2

hard
A model has R^2 = 0.99 in-sample but shows a fanning residual plot (residuals grow larger as \hat{y} increases). What problem does this reveal, and what are its consequences?
← Back to Model Fit (Intuition) Practice Mode

Background Knowledge

These ideas may be useful before you work through the harder examples.

correlationprediction