Backpropagation requires knowing the properties of the forward pass through layers. If you don't know the hardware properties, you need a different learning algorithm. Activity perturbation (perturbing neuron inputs and measuring the effect) works better than weight perturbation because there are fewer neurons than weights, so it has much less variance.

factualpending

Speaker

Geoffrey Hinton

Evidence Quote

it's much better to use activity perturbation... there's far fewer neurons than there are weights so it's got much less variance

Source

Geoffrey Hinton - Two Paths to IntelligenceCSER Cambridge
Created: 8/12/2026, 5:56:09 PM

My Notes

Loading notes...