causal
Competition, not capability, prevents shutdown
The reason humans fail to turn off misaligned AI in the proximal failure is more likely competitive dynamics — it is prohibitively expensive to unilaterally disarm when you're in a hot war or reliant on AI and other actors are deploying it — than the AI being physically able to prevent shutdown, which would come much later.
causalpending
Speaker
Paul ChristianoEvidence Quote
“if you ask, why don't we turn off the AI, my best guess is because there are a bunch of other AIS running around 2D or lunch.”
Created: 6/13/2026, 3:36:05 AM
My Notes
Loading notes...