I am not clear on calories - are insects inefficient?
So basically if you can get food and don't have to spend significant time thinking to do so, there isn't going to be a selective pressure to encourage brain growth. And if you have a selective pressure to devote energy to the brain you're also probably going to have a selective pressure to reduce energy from elsewhere.
Additionally, I'll add that humans both lost fur and stood up because it is better for thermal regulation (there are other pressures too, there's never _one_ reason). So this also helps with the surface area-volume issue.
Basically what I'm saying is that there's these locally optimal conditions that need to exist at the same time to produce intelligent, tool using, civilization making creatures. (I mentioned in another comment that environment matters too. Can't get a bronze age underwater. But I also didn't mention you can't get a bronze age if you don't have a social structure, something, for example, octopi lack). Basically what astrobiologists are looking for are the combination of these optima necessary to produce certain traits. What many commenters here are missing is the combination part, mostly thinking that only intelligence matters to create a space fairing civilization, but you can't get to space if you can't create advanced composites, explosives, and many other things. Or in other words, the astrobiologists aren't idiots and probably know what they are talking about despite what it looks like. It only looks like they are dumb because people are overly simplifying the problem.
Also, what if a non-protein based molecular machinery can be so energy efficient and powerful that species having that can skip some seemingly necessary part of development? But I’m by no means an expert on the topic, just asking. If the reasoning was about absolute limits, I would be much more accepting of them (eg. Energy required by the simplistic work done, like a given skeletal structure picking up a weight with muscles only consuming the minimal physical necessity)
There is no natural speed that life has to operate at. Any aliens we encounter are much more likely to be very, very slow, because it is they who can stand the vast chill void between stars. If they visit, and you dare to chop one down, you wouldn't find anything recognizable as brain inside.