When asked 'How many states in the US have names beginning with the letter K?', ChatGPT confidently answered 'four: Kansas, Kentucky, Kansas, and Kentucky' (listing the same states twice), failing a simple counting task that requires understanding.