Brain size relative to body, not absolute, matters

Humans are smart not because we have the largest brains—elephants and whales have much bigger brains—but because we are highly encephalized (large brain relative to body size) and have a large amount of association cortex, more than any other animal.