Training data will eventually run out

Although the data situation is still quite good with lots remaining, at some point the supply of tokens to train models will run out, and by then we will need other ways of productively improving model capabilities without more data.