The problem with moral reasoning and alignment in AI is not just that values differ across humans, but that there are infinitely many ways to specify the wrong objective function for society, and experience with creating rules (like tax codes) shows we have never succeeded in writing rules without loopholes that malicious actors can exploit.