It's like, a peeping Tom who just looks through a window - yuck that's gross. But a peeping Tom who spies by building a microdrone that can fly in the door when it opens and mount itself on the ceiling with suction pads - oh that's perfectly legitimate because of the work and resources Tom invested.
I mean, if it's gross to do something by accident and it's gross to do something without any investment, it's super gross to do it with resources.
It's not all that hard to track someone across the internet. I think many people have demonstrate hacks that steal legitimate functionality and get you there.
I think we'll probably have to go for a containerised internet (separate apps) and just deal with the disadvantages.
This is already happening with large web publishers.