A fundamental challenge with information maximization methods is that proper definitions of information content require knowing the distribution of vectors, which we do not have; empirical measures are all upper bounds, not lower bounds, so methods use good upper bounds and cross their fingers

factualpending

Speaker

Yann LeCun

Evidence Quote

We come up with a good upper bound and we cross our fingers.

Source

Yann LeCun: World Models: Enabling the next AI revolutionComputer Vision and Geometry Group, ETH Zurich
Created: 8/12/2026, 5:59:01 PM

My Notes

Loading notes...