Double descent is an empirical phenomenon where test error first increases then decreases as model size increases beyond the interpolation threshold, contradicting classical statistical intuition that overfitting increases with model capacity.
factualpending
Speaker
Yann LeCunEvidence Quote
“that argument turns out to be completely false empirically... neural nets are way overparameterized... generalize pretty well... double descent... error goes down... then increases... then decreases again.”
Created: 8/12/2026, 10:03:11 PM
My Notes
Loading notes...