Digital computers have a vastly better way to share knowledge than biological systems: weight/gradient sharing. Multiple copies of the same neural network run on different computers, each examines different data to compute desired weight changes, then all computers agree to average those weight changes so everyone learns from everyone else's data—effectively pooling knowledge at scale.
causalpending
Speaker
Geoffrey HintonEvidence Quote
“they average all their weight changes and then everybody's learned everybody knows what each person each digital computer learned”
Created: 8/12/2026, 5:56:09 PM
My Notes
Loading notes...