Regression Analysis - Formula Sheet
Regression Analysis - Key Formulas
- Simple linear regression: \( Y = a + bX + e \) (a intercept, b slope, e error term)
- Normal equations: \( na + b\sum x = \sum y \); \( a\sum x + b\sum x^2 = \sum xy \)
- \( \hat{a} = \bar{y} - \hat{b}\bar{x} \); \( \hat{b} = \frac{Cov(X,Y)}{V(X)} \)
- \( b_{YX} = r_{XY}\frac{SD(Y)}{SD(X)} = \frac{n\sum xy - \sum x\sum y}{n\sum x^2 - (\sum x)^2} \)
- \( b_{XY} = r_{XY}\frac{SD(X)}{SD(Y)} = \frac{n\sum xy - \sum x\sum y}{n\sum y^2 - (\sum y)^2} \)
- Y on X: \( \hat{Y} - \bar{y} = b_{YX}(x - \bar{x}) \); X on Y: \( \hat{X} - \bar{x} = b_{XY}(y - \bar{y}) \)
- \( r_{XY} = \pm\sqrt{b_{XY} \times b_{YX}} \) (sign of the coefficients)
- \( \frac{b_{XY} + b_{YX}}{2} \ge r_{XY} \)
- Angle between the lines: \( \theta = \tan^{-1}\left(\frac{m_1 - m_2}{1 + m_1 m_2}\right) \)
Quick Facts
- Regression lines intersect at \( (\bar{X}, \bar{Y}) \).
- \( r = 0 \): lines perpendicular; \( r = \pm 1 \): lines coincide.
- Coefficients: same sign; if one exceeds 1 the other is below 1; independent of origin, not of scale.
- Use the fitted equation for interpolation only, not extrapolation.
- Galton coined correlation and regression ("regression towards mediocrity in hereditary stature").
More for this chapter
Book Back Questions19 textbook MCQs · solved
Additional MCQs15 extra MCQs · solved
Practice TestInteractive · instant score
Book Back TestTest yourself on the textbook set
Additional MCQ TestTest yourself on the extra set
Study NotesConcepts & methods