"Imagine someone just up and moving into your yard, without your permission, and then they decide to bulldoze your house because it's getting in the way of <x>."

Sure, it sucks. That's called eminent domain.