One way to scale learning beyond single global objectives is to have gazillions of local objective functions where each small neural unit secretes its own objective function that could be spatially local. You're never trying to learn lots of parameters all at once from one objective function.