Sigreg (Sketch anisotropic Gaussian regularization) prevents JEPA collapse by maximizing information content in encoder outputs through a regularization method based on projecting distributions along multiple axes and ensuring marginal distributions match isotropic Gaussians.
definitionpending
Speaker
Yann LeCunEvidence Quote
“train the encoder so that the distribution... were isotropic multivariate Gaussian... maximum entropy distribution... project the distribution along many axes... characteristic function space... Epps-Pulley.”
Created: 8/12/2026, 10:03:11 PM
My Notes
Loading notes...