Well, if we're talking "fairness", why is it "fair" that someone gets to permanently deny a piece of the Earth to everyone else? It's not like they made it in the first place, it's not even possible to make more. I argue that every fenced-off area incurs a debt to every citizen of the Earth.

The state possesses a monopoly on the use of force, so the only way to acquire a useful place to live is to have money or expose yourself to the state’s wrath.