causal

Programmability enables algorithmic leaps beyond Moore's Law

Because Moore's Law now yields only ~25% per year, the only way to achieve 10x-100x leaps is to change the algorithm and how it's computed yearly; Nvidia's general programmability via CUDA enables new architectures (hybrid SSMs, fused diffusion/autoregressive models, MoEs), which is why Blackwell achieved roughly 50x Hopper's efficiency despite only ~75% transistor improvement.

causalpending

Speaker

Jensen Huang

Evidence Quote

It’s the combination of the programmability of our architecture and the fact that Nvidia is an extreme co-design company.

Source

Dwarkesh Patel Podcast - Jensen Huang – TPU competition, why we should sell chips to China, & Nvidia’s supply chain moatDwarkesh Patel Podcast
Created: 6/13/2026, 3:37:32 AM

My Notes

Loading notes...