The debate around whether large language models can actually do arithmetic shifted recently—GPT-4 can perform arithmetic at a higher success rate—but the fundamental question remains: is the model solving arithmetic from first principles or recognizing patterns of arithmetic from its training data?