Sam Altman wrote a 2017 blog post called 'The Merge' imagining a future where some human beings merge with or integrate their consciousness with superintelligences, allowing humans to participate in the post-human future.

Human preference for working with humans rather than AI systems could slow AI adoption even in domains where AI is technically superior, because people have non-utilitarian reasons to prefer human collaboration.

An important limitation on how quickly AI takes over physical world systems is that even though superintelligences can optimize designs and plan systems, actual physical implementation still requires resources, supply chains, land, zoning permissions, and regulatory compliance that are controlled by humans and governments.

We should not expect that intelligence alone translates directly into the ability to exercise total control over complex political systems—being better at some task like advertising does not automatically confer the ability to control democratic polities.

Hallucinations and errors in AI systems might actually provide an opportunity for regulation because visible failures could motivate governments to regulate AI, whereas the quiet misalignment scenario Kokotajlo predicts offers no moment where humans can learn from experience.