Double descent is an empirical phenomenon where test error first increases then decreases as model size increases beyond the interpolation threshold, contradicting classical statistical intuition that overfitting increases with model capacity.

factualpending

Speaker

Yann LeCun

Evidence Quote

that argument turns out to be completely false empirically... neural nets are way overparameterized... generalize pretty well... double descent... error goes down... then increases... then decreases again.

Source

Yann LeCun: Special Lecture on AI and World ModelsAl-Khwarizmi Applied Mathematics Webinar
Created: 8/12/2026, 10:03:11 PM

My Notes

Loading notes...