Multicollinearity in Multiple Regression

How correlated predictors destabilize regression coefficients and inflate standard errors

Multicollinearity arises when two predictors (X₁, X₂) are highly correlated. Geometrically, the data cloud collapses onto a line — the regression plane loses its support and can "wobble" wildly while still fitting Y well. This inflates standard errors and makes coefficients unreliable.

A concrete example: in personality psychology, the Dark Triad traits — Machiavellianism, narcissism, and psychopathy — are moderately to highly intercorrelated (typically r = 0.4–0.7). Suppose you regress workplace deviance on all three. Even if psychopathy is the strongest unique predictor, its confidence interval will be wide because the three predictors share so much variance. At r = 0.6, VIF ≈ 1.6 — tolerable. But with a short measure that conflates the traits (pushing r toward 0.85), VIF climbs to 3.6 and each SE is inflated by √3.6 ≈ 1.9×. The predictors individually "wash out" even though the model as a whole explains substantial variance. When researchers report that "none of the Dark Triad traits uniquely predicted the outcome" but the overall R² is large, multicollinearity is one common explanation — though short measures, conceptual overlap, and noisy outcomes can also play a role.

Common remedies: (1) Increase sample size — to achieve the same precision you would have with uncorrelated predictors, you need roughly VIF times as many observations (a useful heuristic, not a formal requirement). (2) Combine predictors — replacing near-identical measures with a composite eliminates the collinearity at the cost of granularity. (3) Ridge regression — a small penalty shrinks coefficients toward zero, dramatically reducing variance at the cost of slight bias. (4) Orthogonalize — residualizing one predictor on the other removes collinearity but changes what the coefficients mean, and if the residualized predictor retains little variance the estimates can become even more unstable (for a thorough treatment of why partialing is often a questionable practice, see Hoyle et al., 2023).

X₁–X₂ Predictor Space (projection)
Cross-section (Y on X₁)
Correlation between X₁ and X₂ (r) 0.00
True β₁ (effect of X₁) 0.60
True β₂ (effect of X₂) 0.40
VIF
1.00
SE inflation factor
1.00×
Expected 95% CI for β₁
Expected 95% CI for β₂
The regression plane is well-supported. Coefficient estimates are stable.
Try this: Set β₁ = 1.0 and β₂ = 0, then slowly increase r from 0 to 0.99. The true effect of X₁ never changes, and neither does the estimate — but the 95% CI balloons from roughly ±0.08 to ±0.65, about eight times wider. With this much signal the interval still clears zero, yet it has gone from pinning β₁ down to barely distinguishing a large effect from a modest one. Drop β₁ toward 0.2 and the same widening does push the interval across zero. Now set both β values to 0.50 and increase r: the model predicts Y just as well, but it cannot determine which predictor deserves the credit.
VIF (Variance Inflation Factor) = 1/(1−r²). At r = 0.9, VIF = 5.3; at r = 0.99, VIF = 50. The SE of each coefficient is inflated by √VIF. Rules of thumb: VIF > 5 is concerning, VIF > 10 is severe. The VIF and SE-inflation figures shown above are computed from the population ρ you set with the slider, so they are the true values; a real analysis computes them from the sample, and at these sample sizes the two differ noticeably.
Multicollinearity does not bias the regression coefficients — it only inflates their uncertainty. The model still predicts Y well; it just cannot tell X₁ and X₂ apart.

Citation

Persson, B. N. (2026). Multicollinearity in Multiple Regression [Interactive visualization]. https://bjorn-persson.github.io/visualizations/multicollinearity/

@misc{Persson2026multicollinearity,
  author = {Björn N. Persson},
  year = {2026},
  title = {Multicollinearity in Multiple Regression},
  note = {Interactive visualization},
  url = {https://bjorn-persson.github.io/visualizations/multicollinearity/}}