GPT-1, trained to predict the next word across thousands of books, could not only continue text coherently but answer questions it had not seen—evidence that simple prediction was leading to real understanding, because better next-word prediction (e.g. naming the culprit on the last page of a detective novel) requires deeper comprehension.
causalpending
Speaker
Ilya SutskeverEvidence Quote
“the detective has gathered all the clues...I'm going to reveal the identity of whoever committed the crime...predict that word”
Created: 6/18/2026, 2:18:12 PM
My Notes
Loading notes...