Backpropagation requires knowing the properties of the forward pass through layers. If you don't know the hardware properties, you need a different learning algorithm. Activity perturbation (perturbing neuron inputs and measuring the effect) works better than weight perturbation because there are fewer neurons than weights, so it has much less variance.
factualpending
Speaker
Geoffrey HintonEvidence Quote
“it's much better to use activity perturbation... there's far fewer neurons than there are weights so it's got much less variance”
Created: 8/12/2026, 5:56:09 PM
My Notes
Loading notes...