Information can be maximized by ensuring all rows of a representation matrix are different (making each sample distinct) or all columns are different (making each variable independent), with the latter (dimension contrastive methods) being preferable because independent variables are more informative
factualpending
Speaker
Yann LeCunEvidence Quote
“You want to make sure the columns are different because if all the columns are the same, that means every variable in the representation carries the same information.”
Source
Yann LeCun: World Models: Enabling the next AI revolution— Computer Vision and Geometry Group, ETH ZurichCreated: 8/12/2026, 5:59:01 PM
My Notes
Loading notes...