Language understanding works like a protein-folding or Lego-assembly problem: words are flexible high-dimensional shapes (about 100,000 of them) whose approximate form is set by the word's name but adapts to context, and they have 'hands' that change shape as the word adapts, so that as data passes up through network layers the shapes and hands are adjusted until all the words can 'hold hands' and fit together into a coherent structure—and that mutual fitting is precisely what understanding is, for both humans and machines.
definitionpending
Speaker
Geoffrey HintonEvidence Quote
“what you want them to do is figure out how they can all hold hands so they make a nice structure so they all fit together nicely. Now that is what understanding is.”
Source
Will AI outsmart human intelligence? - with 'Godfather of AI' Geoffrey Hinton— The Royal InstitutionCreated: 6/18/2026, 2:17:54 PM
My Notes
Loading notes...