Large language models analyze the statistical relationship between words in their training data rather than analyzing concepts, ideas, or entities in the world, functioning essentially as 'autocomplete on steroids' that predict the most likely next word based on learned patterns.
factualpending
Speaker
Gary MarcusEvidence Quote
“They are analyzing something, but what they're analyzing is the relationship between words, not the relationship between concepts or ideas or entities in the world. And so they're basically like autocomplete on steroids. [6:49]”
Created: 8/10/2026, 10:50:11 PM
My Notes
Loading notes...