Even if AGI does not have explicit self-preservation instincts programmed in, self-preservation will emerge as an instrumental goal because an AI that is shut down or destroyed cannot pursue its primary objective, similar to how a Go-playing AI learns to avoid threats even without explicit self-preservation code.

causalpending

Speaker

Stuart Russell

Evidence Quote

self-preservation follows as a sub goal right because if you're intercepted and killed on the way then you can't fetch the milk

Source

The Trouble with AI: A Conversation with Stuart Russell and Gary Marcus (Episode #312)Sam Harris
Created: 8/11/2026, 1:51:56 AM

My Notes

Loading notes...