GPT-1, trained to predict the next word across thousands of books, could not only continue text coherently but answer questions it had not seen—evidence that simple prediction was leading to real understanding, because better next-word prediction (e.g. naming the culprit on the last page of a detective novel) requires deeper comprehension.

causalpending

Speaker

Ilya Sutskever

Evidence Quote

the detective has gathered all the clues...I'm going to reveal the identity of whoever committed the crime...predict that word

Source

How LLMs Took Over The WorldArt of the Problem
Created: 6/18/2026, 2:18:12 PM

My Notes

Loading notes...