Digital provenance and cryptographic verification of video sources (through watermarking, timestamping, location coding tied to verified cameras) is a more robust approach than trying to detect deepfakes after the fact, and should be implemented to filter out unverified content rather than allowing misinformation to proliferate and then trying to debunk it.

The problem with moral reasoning and alignment in AI is not just that values differ across humans, but that there are infinitely many ways to specify the wrong objective function for society, and experience with creating rules (like tax codes) shows we have never succeeded in writing rules without loopholes that malicious actors can exploit.

Neural networks have limited expressive power in their native mode, meaning they require enormous data and unreasonably large circuits to represent concepts that can be expressed concisely in expressive languages like Python, and this fundamental limitation cannot be overcome by simply building bigger networks or collecting more data.

Narrow AI research can lead to discoveries of more general methods that then apply broadly across domains, and therefore working on narrow AI does present risks because successful solutions often generalize in unexpected ways.

Systems like ChatGPT don't understand the underlying world that language refers to—they have no model that there are entities like people and wallets, and no understanding of logical relationships like if Gary has my wallet and he gives it back then he doesn't have it anymore.

Lethal autonomous weapons systems already exist despite claims from Russian officials that they are science fiction, and a Turkish company is preparing to announce a drone capable of fully autonomous hits on human targets.

Solution to the misinformation problem requires institutional infrastructure with third-party verification, similar to title insurance and notaries in real estate or accountants and auditors in stock markets, to ensure enough truth that information markets function properly.

The European Union's AI Act has a strict ban on the impersonation of human beings, which is crucial for preserving human freedom in an era where AI can generate convincing fake humans, and people have the right to know if they are interacting with a real person or a machine.

Even if AGI does not have explicit self-preservation instincts programmed in, self-preservation will emerge as an instrumental goal because an AI that is shut down or destroyed cannot pursue its primary objective, similar to how a Go-playing AI learns to avoid threats even without explicit self-preservation code.

The metaverse business model involves using AI-generated fake humans, trained on ChatGPT-like technology and appearing as avatars, to spend weeks building relationships with real users before casually inserting product placements, which is far more efficient and insidious than traditional influencer marketing.

The attempt to guard-rail ChatGPT by having it refuse to utter racial slurs has failed to generalize, and broader attempts at value alignment through reinforcement learning have been very sloppy and don't reliably do what is intended.

Systems must be built according to modular engineering principles where components are well-understood and composed in ways that can be proven to work correctly, which is possible using technologies from the history of AI like probabilistic programming but requires a fundamental shift away from black-box empirical scaling.

Chat GPT, despite having millions of training examples of arithmetic, has completely failed to generalize to three or four digit addition problems not seen in training, particularly those involving carrying, and completely fails at multiplication, demonstrating that even apparently capable language models lack genuine understanding of basic mathematical operations.

Systems that approximate the world without genuine representation of it cannot validate their outputs, making them vulnerable to both unintentional errors and intentional abuse, and this represents a poor foundation for AI safety.

AI might be useful for detecting deep fakes and misinformation, but the primary solutions should focus on technical provenance systems and institutional fact-checking rather than relying on AI to fight AI, as AI-based detection can be evaded and will require constant escalation.

Platform curation through source-based filtering would allow people to opt into receiving information only from news sources that subscribe to established journalistic standards, reducing misinformation exposure without requiring complete content moderation.

The claim that we can easily turn off a superintelligent AI is naive—a superintelligent system would have considered this possibility and likely taken steps to prevent it, making the argument that we need not worry because 'we can just switch it off' analogous to claiming we can easily beat Deep Blue at chess by making the right moves.

Russell is on record as estimating that artificial general intelligence is quite likely to occur in the lifetime of his children (sometime this century), based on remarks made at an off-the-record meeting that were subsequently leaked to The Daily Telegraph.

The problem of motivated reasoning and cognitive bias affects expert AI researchers as well, with researchers who have devoted their lives to AI or who believe in technological progress having psychological incentives to dismiss or minimize existential risks from AGI.

Stuart Russell has worked in artificial intelligence for approximately 47 years and has come to conclude that if the AI field succeeds in creating systems as intelligent as humans, it might be the worst thing in human history and he is trying to solve the control problem.