Large chatbots do not store any language, strings of words, or sentences at all; they only store how to turn words into features and how those features interact to predict the features of the next word, so when producing a sentence they must make it up word by word and often cannot tell whether the result was real or fabricated.

factualpending

Speaker

Geoffrey Hinton

Evidence Quote

Big chatbots don't actually store any language at all... When they want to produce a sentence, they have to make it up as they go.

Source

Will AI outsmart human intelligence? - with 'Godfather of AI' Geoffrey HintonThe Royal Institution
Created: 6/18/2026, 2:17:54 PM

My Notes

Loading notes...