The better a neural network can predict the next word in text, the more it understands language—this is important because prediction is a proxy for understanding, as shown by the analogy that understanding a complex detective novel means being able to correctly predict the final reveal of the criminal's identity.