I like to imagine there is this magic wall between properties where nothing ever crosses over and in that situation we could somehow allow an absolute property rights sort of thing.

The catch is that it just doesn't work that way.