Video is more redundant than text, which is actually a feature rather than a bug for self-supervised learning because redundancy in data is necessary for learning; without redundancy you cannot learn anything
factualpending
Speaker
Yann LeCunEvidence Quote
“If you want to train a system, particularly using self-supervised learning, you need redundancy in the in the data. If you don't have redundancy, you can't learn anything.”
Source
Yann LeCun: World Models: Enabling the next AI revolution— Computer Vision and Geometry Group, ETH ZurichCreated: 8/12/2026, 5:59:01 PM
My Notes
Loading notes...