Sigreg (Sketch anisotropic Gaussian regularization) prevents JEPA collapse by maximizing information content in encoder outputs through a regularization method based on projecting distributions along multiple axes and ensuring marginal distributions match isotropic Gaussians.

definitionpending

Speaker

Yann LeCun

Evidence Quote

train the encoder so that the distribution... were isotropic multivariate Gaussian... maximum entropy distribution... project the distribution along many axes... characteristic function space... Epps-Pulley.

Source

Yann LeCun: Special Lecture on AI and World ModelsAl-Khwarizmi Applied Mathematics Webinar
Created: 8/12/2026, 10:03:11 PM

My Notes

Loading notes...