Automated interpretability trust concern

Using neural networks to audit neural networks raises a 'reflections on trusting trust' problem: if you rely on powerful AI to verify that your AI systems are safe, you must worry whether the auditing model could be screwing with you — a concern Olah considers minor now but potentially serious in the long run.