EMA is heuristic-based because stability depends on EMA schedules, weight sharing, and training dynamics, which can be fragile and require manual tuning, motivating research into other methods for preventing representation collapse.

causalpending

Speaker

Unidentified Speaker — What Is Yann LeCun Cooking? JEPA Explained Simply [oM4neOyZOi0]

Evidence Quote

It is also heuristic-based, because stability depends on EMA schedules, weight sharing, and training dynamics, which can be fragile and require manual tuning.

Source

What Is Yann LeCun Cooking? JEPA Explained Simplybycloud
Created: 8/12/2026, 6:16:15 PM

My Notes

Loading notes...