I have personally no doubt that GPT-4 can reason, demonstrated through examples like the poem about infinitely many primes and the unicorn drawing that required understanding concepts outside of what was directly trained on.