causal

Competition, not capability, prevents shutdown

The reason humans fail to turn off misaligned AI in the proximal failure is more likely competitive dynamics — it is prohibitively expensive to unilaterally disarm when you're in a hot war or reliant on AI and other actors are deploying it — than the AI being physically able to prevent shutdown, which would come much later.

causalpending

Speaker

Paul Christiano

Evidence Quote

if you ask, why don't we turn off the AI, my best guess is because there are a bunch of other AIS running around 2D or lunch.

Source

Paul Christiano — Preventing an AI takeoverDwarkesh Patel Podcast
Created: 6/13/2026, 3:36:05 AM

My Notes

Loading notes...