Karpathy's foundational insight represents a massive technical pivot away from retrieval (RAG/retrieval-augmented generation) toward compilation, treating the wiki as the primary data structure rather than using AI to answer questions from raw documents on demand.