Interpolation Roulette

Spin the same synthetic regression problem through a ridge estimator and a ridgeless (min-norm interpolating) estimator side by side, and watch what happens to their held-out error in the tail.

arXiv:2607.09547 ↗

What the paper actually shows

High-Dimensional Interpolators Can Be Fragile (Zhu & Lu, 2026) studies min-norm interpolating ("ridgeless") linear regression in high dimensions and asks: sure, it's accurate on average — but how bad can a single unlucky draw of the data get?

Their answer, via large-deviation theory: ridgeless regression's held-out risk can be heavy-tailed. Even when its expected risk looks fine, its probability of a catastrophically bad fit decays much more slowly than a ridge-regularized estimator's does.

"Ridge regularization suppresses fixed right-tail deviations at the n² scale, whereas ridgeless regression has only n log n-scale decay" — from the abstract.

Ridge tail decay

∝ n²

Ridgeless tail decay

∝ n·log n

n log n grows far slower than n², so the ridgeless large-deviation exponent is weaker — rare catastrophic errors stay comparatively likely even as data grows. That's the "statistically fragile" claim.

This simulator is an illustrative toy: it fits real ridge / min-norm regression on fresh synthetic data every spin and shows real held-out error. It does not attempt to numerically reproduce the paper's exact asymptotic constants — those are proven in a large-n, large-d limit, not measurable from a browser demo. Treat the histograms as a qualitative echo of "accurate on average, fragile in the tail," not a replica of the theorem.

Dial the regime

Dimension / sample-size ratio d/n 0.75

d = 50 (fixed) · n = 67

—

Noise heavy-tailedness df = 3

Student-t noise · lower df = heavier tail

Ridge strength λ 3.0

Higher λ = more shrinkage, more bias, less variance

Space spin once · A toggle auto-spin · R reset

Ridge — regularized

Shrinks coefficients toward zero. Boring on purpose.

Last held-out MSE

—

Spins

Mean MSE

–

Worst MSE

–

Catastrophic

–

Ridgeless — min-norm interpolator

Fits training data as closely as possible. Usually fine. Not always.

Last held-out MSE

—

Spins

Mean MSE

–

Worst MSE

–

Catastrophic

–