I agree but I would say that any advanced enough civilisation will even be able to eliminate the need to grow their population and energy requirements.

I don't see any requirement why an intelligent civilisation would need to grow its population forever. It seems far more intelligent to attack the cause of the energy need instead of building crazy structures like Dyson spheres around black holes.