causal
Programmability enables algorithmic leaps beyond Moore's Law
Because Moore's Law now yields only ~25% per year, the only way to achieve 10x-100x leaps is to change the algorithm and how it's computed yearly; Nvidia's general programmability via CUDA enables new architectures (hybrid SSMs, fused diffusion/autoregressive models, MoEs), which is why Blackwell achieved roughly 50x Hopper's efficiency despite only ~75% transistor improvement.
causalpending
Speaker
Jensen HuangEvidence Quote
“It’s the combination of the programmability of our architecture and the fact that Nvidia is an extreme co-design company.”
Source
Dwarkesh Patel Podcast - Jensen Huang – TPU competition, why we should sell chips to China, & Nvidia’s supply chain moat— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:37:32 AM
My Notes
Loading notes...