Understanding how AI systems work inside (their 'lumps of irreducible computation') is not necessary for using them, just as understanding how horses work internally was not necessary for riding them; this is a return to how technology worked before the industrial revolution made it simple enough to understand.