There is no finite set of metrics or values adequate to specify what an advanced AI system should optimize for, because any metric can be gamed, any specification of a goal contains unstated assumptions, and any real-world scenario involves complexities and trade-offs that cannot be fully anticipated or formalized

normativepending

Speaker

Daniel Schottenberger

Evidence Quote

is there a finite describable definition of good is another way of thinking about it right

Source

The Dark Side of Conscious Ai | Daniel SchmachtenbergerCurt Jaimungal
Created: 8/10/2026, 10:48:51 PM

My Notes

Loading notes...