Training JEPA architectures faces the 'collapse' problem: if you simply minimize prediction error in representation space, the system can cheat by predicting constant representations, making the prediction trivial and useless.
factualpending
Speaker
Yann LeCunEvidence Quote
“when you train a system like this and minimize prediction error in representation space, it can cheat... predict a constant representation... That's called a collapse.”
Created: 8/12/2026, 10:03:11 PM
My Notes
Loading notes...