The hard, non-obvious realization was that training neural networks to predict the next token is a worthwhile goal at all—a recognition that heavily influenced researchers' thinking.