It did happen, several times! But the randomness of weather, volcanoes, disease etc squashed them. Ours is just the lucky combination of critical mass and congenial weather patterns.

On the other hand, Neanderthal had quite a bigger brain than us; but fewer of the social impulses. We're likely dumber but more socialized, which reinforces your theme I guess!