A fundamental challenge with information maximization methods is that proper definitions of information content require knowing the distribution of vectors, which we do not have; empirical measures are all upper bounds, not lower bounds, so methods use good upper bounds and cross their fingers
factualpending
Speaker
Yann LeCunEvidence Quote
“We come up with a good upper bound and we cross our fingers.”
Source
Yann LeCun: World Models: Enabling the next AI revolution— Computer Vision and Geometry Group, ETH ZurichCreated: 8/12/2026, 5:59:01 PM
My Notes
Loading notes...