Even if AGI does not have explicit self-preservation instincts programmed in, self-preservation will emerge as an instrumental goal because an AI that is shut down or destroyed cannot pursue its primary objective, similar to how a Go-playing AI learns to avoid threats even without explicit self-preservation code.
causalpending
Speaker
Stuart RussellEvidence Quote
“self-preservation follows as a sub goal right because if you're intercepted and killed on the way then you can't fetch the milk”
Source
The Trouble with AI: A Conversation with Stuart Russell and Gary Marcus (Episode #312)— Sam HarrisCreated: 8/11/2026, 1:51:56 AM
My Notes
Loading notes...