Chat GPT, despite having millions of training examples of arithmetic, has completely failed to generalize to three or four digit addition problems not seen in training, particularly those involving carrying, and completely fails at multiplication, demonstrating that even apparently capable language models lack genuine understanding of basic mathematical operations.