We need less people in places that cannot support having as many people as they already have. Building sprawling exurbs in the southwestern deserts comes to mind. Or some other cases that cannot be acknowledged in polite company.

Most developed nations are below replacement rate, and you don't have to look far in places like the northeast or midwest of the US to see places that are going to seed and reverting back into wilderness.