LeJepa constrains the overall geometry of the embedding space to follow an isotropic Gaussian distribution, meaning representation space spreads information evenly across dimensions so no direction collapses or dominates.
factualpending
Evidence Quote
“It specifically encourages the embeddings to follow an isotropic Gaussian distribution, meaning the representation space spreads information evenly across dimensions, so no direction collapses or dominates.”
Created: 8/12/2026, 6:16:15 PM
My Notes
Loading notes...