The scaling of neural networks to larger sizes trained on more data was anticipated in the academic literature well before ChatGPT, but what was not anticipated was that this scaling would lead to systems that could manipulate language as well as or better than most humans.