A Transformer generates output autoregressively—producing tokens one at a time, appending each completed token back into the input sequence and generating the next from the whole thing—and this one-at-a-time mechanism, considering all patterns everywhere at once via multiple attention heads, is why the model is so incredibly effective.

Electron-to-token transformation resists commoditization

The transformation of electrons into valuable tokens involves so much artistry, engineering, science, and ongoing invention—and is so far from being fully understood—that even as it becomes more efficient, the core work Nvidia does in the middle will not be commoditized.

Agentic tool use will make software tools skyrocket

Because most software companies are tool makers (Excel, PowerPoint, Cadence, Synopsys), and AI agents will use those tools, the number of agents and tool instances will grow exponentially once agents get good enough at tool use—the opposite of the view that AI commoditizes software.

CUDA's value is install base and ecosystem, not just kernels

CUDA's enduring value comes from three reinforcing factors: a rich ecosystem where every framework works and bugs are more likely in your code than the stack; the largest install base of hundreds of millions of GPUs across every cloud and device; and ubiquity across all clouds and on-prem—so software written for CUDA runs everywhere, making it invaluable even though some customers write their own kernels.

Programmability enables algorithmic leaps beyond Moore's Law

Because Moore's Law now yields only ~25% per year, the only way to achieve 10x-100x leaps is to change the algorithm and how it's computed yearly; Nvidia's general programmability via CUDA enables new architectures (hybrid SSMs, fused diffusion/autoregressive models, MoEs), which is why Blackwell achieved roughly 50x Hopper's efficiency despite only ~75% transistor improvement.

Architecture outweighs lithography in performance

Performance gains come far more from architecture and computer science than from lithography: Blackwell is 50x Hopper while the transistors improved only ~75% over three years, so a 5nm-vs-7nm gap is not a 10x difference—meaning China being stuck on 7nm does not preclude competitive systems when networking, architecture, and energy are combined.

Energy and chips are substitutable AI inputs

In the five-layer AI cake with energy at the base, an abundance of energy compensates for weaker chips and vice versa: the energy-scarce US must advance architecture for maximum throughput-per-watt, while energy-abundant China can use older 7nm (Hopper-class) chips and simply use more of them.

Nvidia missed early lab investment due to capital constraints

Huang's mistake was not internalizing that foundation labs like Anthropic and OpenAI needed multi-billion-dollar investments from suppliers (which VCs wouldn't provide) to use compute; Google and AWS could make those investments and Nvidia couldn't at the time, which is why Anthropic went elsewhere—a mistake he won't repeat now that Nvidia can invest in OpenAI and Anthropic.

Job vs task distinction explains automation fears

Automation fears confuse jobs with tasks: a radiologist's job is patient care while reading a scan is only a task, so even free, superhuman computer vision doesn't eliminate the role—misunderstanding this drives people away from training for needed careers and produces shortages.

Nvidia would be large even without the AI revolution

Even without deep learning, Nvidia would be very large because general-purpose computing has largely exhausted its scaling, and domain-specific acceleration via GPU+CUDA speeds applications 100x-200x across graphics, molecular dynamics, seismic processing, fluid dynamics, and structured data—the company's mission was accelerated computing broadly, with AI as one beneficiary.

Accelerated computing is broader than tensor processing

Nvidia builds accelerated computing—usable for molecular dynamics, quantum chromodynamics, fluid dynamics, data processing, and AI—rather than a narrow tensor processing unit, giving it far greater market reach than any TPU or ASIC can achieve.

Doomer warnings discourage needed labor supply

Telling people AI will eliminate careers (software engineering, radiology) discourages people from entering those fields and risks real shortages, just as a decade ago warnings that radiology would be automated coincided with today's shortage of radiologists.

Supply chain bottlenecks resolve within two to three years

No supply-chain bottleneck (CoWoS, logic fabs, HBM, EUV machines) lasts longer than two to three years once a clear demand signal exists, because once you can build one you can build ten and then a million; the only hard, durable constraints are downstream—energy and skilled trades like plumbers and electricians.

Supply chain invests in Nvidia because of downstream demand

Nvidia's suppliers make large upstream investments specifically for Nvidia rather than competitors because they trust Nvidia has the downstream demand and reach to buy their supply and sell it through; without that demand reach, no one builds a supply chain for an architecture whose business churns are low.

Nvidia optimization doubles partner model performance

Because no one knows Nvidia's architecture better than Nvidia, its engineers routinely get partner AI labs another 2x-3x out of their stack or a particular kernel, which—across an installed fleet of Hoppers and Blackwells—directly doubles revenue, so Nvidia's expertise remains needed even for sophisticated customers.

Hyperscaler GPU demand is mostly external customers

Although the top five hyperscalers are 60% of Nvidia's revenue, most of that business serves external customers (e.g., most Nvidia capacity in AWS, Azure, and all of OCI is for external customers, not internal use), because Nvidia's reach brings the cloud providers a large base of AI companies built on Nvidia.

Nvidia has the best performance-per-TCO in the world

Nvidia's computing stack delivers the best performance per total cost of ownership of any platform, evidenced by competitors (TPU, Trainium) declining to publish results on open benchmarks like InferenceMAX or MLPerf despite claiming cost advantages.

Do as much as needed, as little as possible

Nvidia's guiding philosophy is to do only the work that wouldn't get done otherwise (building the stack, CUDA, NVLink, domain-specific libraries) wholeheartedly, while doing as little as possible elsewhere—which is why it doesn't become a cloud or hyperscaler, since clouds would exist without Nvidia but its core platform work would not.

Anthropic alone explains TPU and Trainium growth

ASIC adoption is not a broad trend but a single instance: essentially 100% of TPU growth and 100% of Trainium growth is attributable to Anthropic, so there is not an abundance of ASIC opportunities—there is only one Anthropic.

Highest tokens-per-watt maximizes data center revenue

Because a data center's revenue is proportional to the tokens it produces, and energy is the binding constraint, the architecture with the highest tokens-per-watt maximizes revenue for a fixed-gigawatt facility—and Nvidia claims to be the highest tokens-per-watt architecture in the world.