The approach of attempting to build general-purpose AI without domain-specific knowledge is failing; companies tried this with simple wrappers around large language models for a year or two and the approach 'miserably failed' because these products could not achieve the 99.99% reliability required for real-world use, whereas they currently only reach ~80% reliability.

factualpending

Speaker

Arvin Narayan

Evidence Quote

products that were simple wrappers around large language models...have been pretty bad failures...gotten the reliability rate up from let's say like 80% where it is now all the way to 99.99%

Source

AI Snake Oil: What Artificial Intelligence Can Do, What It Can’t, and How to Tell the DifferenceMIT Stone Center on Inequality & Shaping Work
Created: 8/11/2026, 6:51:26 AM

My Notes

Loading notes...