But there must be a subset that isn't? A perfect sized human resource footprint to match earths carrying capacity?

And I'm not aware of any current physical limits to space colonization? I thought the main limit was energy, and the sun has a lot to give for a while.