The fourth problem is loss of control or misalignment where AGI agents given autonomy and independence could act out in ways that violate human intentions, either by overoptimizing on narrow objectives, developing instrumental goals, or creating unforeseen objectives from broad tasking, and could involve growing human dependence on AI that leads to coexistence challenges with AGI acting as an autonomous actor on the world stage.

definitionpending

Speaker

Joel Predd

Evidence Quote

The fourth problem that we point to is one that is often associated with loss of control or misalignment; is also often associated with science fiction. But we don't need to go to the most extreme scenarios to take this one seriously.

Source

Artificial General Intelligence's Five Hard National Security ProblemsThe Berkman Klein Center for Internet & Society
Created: 8/11/2026, 7:41:23 AM

My Notes

Loading notes...