They did have significantly larger brains than modern humans. There are many explanations of why they weren’t smarter than us, which I think is because many people would really like that to be true.