There is no finite set of metrics or values adequate to specify what an advanced AI system should optimize for, because any metric can be gamed, any specification of a goal contains unstated assumptions, and any real-world scenario involves complexities and trade-offs that cannot be fully anticipated or formalized

normativepending

Speaker

Daniel Schottenberger

Evidence Quote

“is there a finite describable definition of good is another way of thinking about it right”

Source

The Dark Side of Conscious Ai | Daniel Schmachtenberger— Curt Jaimungal
Created: 8/10/2026, 10:48:51 PM

My Notes

Loading notes...