I don't think this is at all analogous to speech. For example, you might be entitled to say whatever you want under free speech protections in the US, but that doesn't mean you're allowed to walk up to random people and shout in their face. If you do that long enough you'll definitely earn yourself some misdemeanors. If you consistently did it to a particular person against their wishes, you'd eventually get some kind of harassment felony charge.