Labels on misleading content—such as marking vaccine-related misinformation even when individual claims are technically true—can help people understand context and base rates, as when Robert Kennedy claims a seizure followed vaccination without noting that seizures are rare in the vaccinated population.

Bad actors can use systems like ChatGPT to generate unlimited variants of misinformation, such as creating hundreds of versions of vaccine propaganda or false Q-Anon narratives with fabricated citations to real journals, making the cost of producing convincing falsehoods approach zero.

There is a distinction between a system's intelligence and a system's power—a dumb system with access to many resources can be dangerous, and even superintelligence could theoretically be constrained if it had limited access to the world, so the two concepts should be separated in discussion of AI risks.

The core difference between two approaches to addressing AGI risk is that some believe we should pursue more transparent, understandable AI (like probabilistic programming) while others worry that making AI more capable and more understandable simultaneously solves the transparency problem while creating a worse control problem.

Stuart Russell has moved from being earlier skeptical of imminent AGI risk to becoming more worried about near-term risks from narrow AI systems deployed with misaligned objectives and lack of regulatory oversight, particularly following the Microsoft Bing ChatGPT incident.

The fact that Microsoft had internal evidence that its Bing ChatGPT system was problematic before rolling it out anyway, and then could test it on 100 million people without clear understanding of consequences, shows that the largest tech companies lack both regulatory oversight and internal mechanisms to ensure AI safety.

Yellow journalism in the 1890s reached a peak of sensationalism that society has dealt with historically through increased fact-checking and curation, and a similar approach may be necessary now rather than trying to distinguish true from false content algorithmically.

Gary Marcus was able in a social media debate to demonstrate that in four minutes using his company's templates and AI-generated images, he could create a completely authentic-looking but entirely false news story about Antifa causing January 6th, showing that the tools for large-scale misinformation production are already available.

Russia has used armies of troll farms and thousands of fake accounts to disseminate misinformation at scale, demonstrating that the infrastructure for distributing deep fakes and AI-generated content already exists.

Educational campaigns to improve AI literacy and web literacy are necessary but face resistance because most people no longer care about privacy or source verification, suggesting that behavioral change through education alone is insufficient without structural incentive changes.

Gary Marcus's written work includes an article titled 'David Beats Goliath' about Stuart Russell's Go research, connecting it to historical AI limitations in Minsky and Papert's Perceptrons and drawing lessons about deep learning's fundamental limitations.

One possibility for AGI safety is to equip artificial general intelligence systems with the ability to compute consequences for society and reason about specified values like democracy, empowering the AI to either refuse to do harmful things or at least raise concerns about societal consequences.

Even if we don't have consensus on human values, the alternative is not anarchy but rather attempting to articulate and work toward consensus values while acknowledging that perfect alignment is impossible, similar to how democracy attempts consensus governance without requiring universal agreement.

Treating advanced AI development similarly to drug trials—with mandatory understanding of costs and benefits, slow release protocols, and regulatory oversight—would be appropriate given the stakes, but no such regulatory framework currently exists.

The most serious consequence of ChatGPT-style hallucination is that these systems are being deployed as search engines that give medical advice, and people will follow that advice and be harmed, whereas the most serious consequence of adversarial misuse is destruction of shared reality and thus democracy itself.

The problem with Perceptrons was that it appeared to prematurely dismiss multi-layer networks, but the underlying insight about the limits of connectionist architectures remains valid even as networks have become much deeper and more sophisticated.

Misinformation and deep fake problems will escalate dramatically as AI tools become more accessible and capable, and the problem will become critical before the 2024 election—waiting until after that election may be too late.

Some capabilities of Chat GPT are difficult to explain as mere stitching together of training data patterns, and it's possible that the system is developing internal representational structures that support more expressive reasoning than it appears, though this remains unproven and controversial.

Large language models analyze the statistical relationship between words in their training data rather than analyzing concepts, ideas, or entities in the world, functioning essentially as 'autocomplete on steroids' that predict the most likely next word based on learned patterns.

Large language models are the most versatile AI technique ever developed but also the least reliable AI technique that has ever gone mainstream, making them unique in requiring human oversight for nearly all practical applications.