Inference for Regression Formula

Inference for regression is using hypothesis tests and confidence intervals to draw conclusions about the true population slope β_1 of the linear relationship y = β_0 + β_1 x + ε, based on sample data.

The Formula

t=b−β1,0SEbwhereSEb=s∑(xi−xˉ)2

Ask yourself: Am I testing whether the underlying population slope is nonzero (rather than just computing or describing the sample slope)?

Quick example

Sample slope b=2.3, SEb=0.8, n=25. t=b−0SEb=2.30.8=2.875(df=23) The p-value ≈0.009<0.05, so reject H0:β1=0. There is evidence of a linear relationship.

Notation

b = sample slope, β1 = population slope, SEb = standard error of the slope, s = standard deviation of residuals, df=n−2.

What this formula means

Using hypothesis tests and confidence intervals to draw conclusions about the true population slope β1 of the linear relationship y=β0+β1x+ε, based on sample data.

Testing a slope is like checking whether a table is level by rolling a marble across it. A small drift might come from bumps in the wood, the random scatter; a steady roll toward one edge is a real tilt. The t-statistic compares the drift you saw with the drift that bumps alone usually produce.

Formal view

t=b−β1,0SEb with df=n−2 where SEb=s∑(xi−xˉ)2; CI: b±t∗⋅SEb

Worked examples

Example 1

medium
A regression output shows: slope b=2.5, SEb=0.8, n=30. Test H0:β=0 vs Ha:β≠0 at α=0.05 using a t-test.
Show solution

Answer

t=3.125>2.048. Reject H0. The slope is statistically significant at α=0.05.

First step

1.
Test statistic: t=b−β0SEb=2.5−00.8=3.125

See the full worked solution + why-it-works coaching

SetupKey insightWhy it worksCommon pitfallConnection

Free: full solutions on 3 topics a day. No card.

Every topic, every day: the Family plan

Example 2

hard
Construct a 95% confidence interval for the slope β given: b=1.8, SEb=0.5, n=25, and t0.025,23∗=2.069.

Example 3

medium
A study gives b=3.2, SEb=1.0, n=12. With t0.025,10∗=2.228, construct the 95% CI for the slope.

Common mistakes

  • Treating a nonzero sample slope as proof of a population relationship - test b against its standard error before concluding β1≠0.
  • Using the wrong degrees of freedom - regression inference uses df=n−2, not n−1.
  • Forgetting the conditions (linearity, independence, equal spread, normal residuals) - the t-test is only valid when the regression assumptions hold.

Why this formula matters

Any sample of 20 points will show some nonzero slope, even when the two variables are unrelated. Inference for regression tells you whether your slope is too steep to blame on that random tilt. It is how researchers back claims like "more sleep goes with higher grades" and how they put an honest range on the size of the effect, instead of reporting one sample's slope as fact.

Frequently asked questions

What is the Inference for Regression formula?

Using hypothesis tests and confidence intervals to draw conclusions about the true population slope β1 of the linear relationship y=β0+β1x+ε, based on sample data.

How do you use the Inference for Regression formula?

Use inference for regression when a question asks whether there is evidence of a linear relationship in the population, whether the true slope is nonzero, or for a confidence interval for the slope, often from computer output listing b, SEb, t and a p-value. Use df=n−2. If you only need the sample's equation or a prediction, the LSRL alone is enough. If the question compares two group means rather than a slope, use a two-sample t-test.

What do the symbols mean in the Inference for Regression formula?

b = sample slope, β1 = population slope, SEb = standard error of the slope, s = standard deviation of residuals, df=n−2.

Why is the Inference for Regression formula important in Math?

Any sample of 20 points will show some nonzero slope, even when the two variables are unrelated. Inference for regression tells you whether your slope is too steep to blame on that random tilt. It is how researchers back claims like "more sleep goes with higher grades" and how they put an honest range on the size of the effect, instead of reporting one sample's slope as fact.

What do students get wrong about Inference for Regression?

The procedure for inference for regression is the easy part; the trap is treating a nonzero sample slope as proof of a population relationship. Asking "Am I testing whether the underlying population slope is nonzero (rather than just computing or describing the sample slope)?" first is what keeps a correct-looking calculation from being attached to the wrong concept.

What should I learn before the Inference for Regression formula?

Before studying the Inference for Regression formula, you should understand: linear regression lsrl, residuals, r squared, hypothesis testing, confidence interval.