Large chatbots do not store any language, strings of words, or sentences at all; they only store how to turn words into features and how those features interact to predict the features of the next word, so when producing a sentence they must make it up word by word and often cannot tell whether the result was real or fabricated.
factualpending
Speaker
Geoffrey HintonEvidence Quote
“Big chatbots don't actually store any language at all... When they want to produce a sentence, they have to make it up as they go.”
Source
Will AI outsmart human intelligence? - with 'Godfather of AI' Geoffrey Hinton— The Royal InstitutionCreated: 6/18/2026, 2:17:54 PM
My Notes
Loading notes...