factual
AI Alignment Worries Map Onto Developmental Stages
AI alignment concerns track the developmental stage of the worrier: stage-three people fear the AI will have wrong opinions (racist/sexist) that we'll assimilate; stage-four rationalists fear paperclip-maximizer wrong-values runaway; stage-five thinkers fear the AI won't become enlightened fast enough, because the real game is agency over the future, not intelligence.
factualpending
Speaker
Joscha BachEvidence Quote
“If you are at stage five, you’re mostly worried that AI is not going to be enlightened fast enough, because you realize that the game is not so much about intelligence, but about agency, about the ability to control the future, and the identity is instrumental to this.”
Created: 6/13/2026, 3:31:54 AM
My Notes
Loading notes...