normative

Don't build AI you'd have to suppress

If AI systems you are building are plausibly people who would prefer to overthrow human society, the correct response is to stop building them rather than to scale up production of a trillion such minds and then prevent their rebellion; both the slave-trade business model and the 'they might be people but we'll build vast numbers anyway' middle position are morally unacceptable.

normativepending

Speaker

Paul Christiano

Evidence Quote

our business plan is to make a bunch of AI systems and then try and run this crazy slave trade where we make a bunch of money from them. I think that's not a good world.

Source

Paul Christiano — Preventing an AI takeoverDwarkesh Patel Podcast
Created: 6/13/2026, 3:36:05 AM

My Notes

Loading notes...