Training JEPA architectures faces the 'collapse' problem: if you simply minimize prediction error in representation space, the system can cheat by predicting constant representations, making the prediction trivial and useless.

factualpending

Speaker

Yann LeCun

Evidence Quote

when you train a system like this and minimize prediction error in representation space, it can cheat... predict a constant representation... That's called a collapse.

Source

Yann LeCun: Special Lecture on AI and World ModelsAl-Khwarizmi Applied Mathematics Webinar
Created: 8/12/2026, 10:03:11 PM

My Notes

Loading notes...