The main thing with the "random person you've never spoken to" is this: It might be something you do from time to time. It might be something she deals with once or twice a week - or daily. You might be respectful and asking, but many others aren't. If you haven't even had a brief conversation, she likely knows it is all based on looks and absolutely nothing about her personality.
You won't personally be harassing her, no. But overlooking this stuff is being ignorant of how she might be treated on a daily basis and it can make you part of the problem, depending on the context of the situation. It isn't like it is hard to simply move on: You likely do this with people that aren't prospective dates in your eyes.
Yes, it's sad that you may lose the love of your life this way. It's sadder that many women lose their actual lives over this kind of thing.
So you can't ask people you don't know out on a date? That's harassment now?