The approach of attempting to build general-purpose AI without domain-specific knowledge is failing; companies tried this with simple wrappers around large language models for a year or two and the approach 'miserably failed' because these products could not achieve the 99.99% reliability required for real-world use, whereas they currently only reach ~80% reliability.
factualpending
Speaker
Arvin NarayanEvidence Quote
“products that were simple wrappers around large language models...have been pretty bad failures...gotten the reliability rate up from let's say like 80% where it is now all the way to 99.99%”
Source
AI Snake Oil: What Artificial Intelligence Can Do, What It Can’t, and How to Tell the Difference— MIT Stone Center on Inequality & Shaping WorkCreated: 8/11/2026, 6:51:26 AM
My Notes
Loading notes...