I tend to elicit the feeling you are mentioning often, without intending to. I have seen old women move away from me while we were waiting to cross the street. I have been stopped by police because “I was acting suspicious” (I was walking to the gym, after work).

It’s not a nice feeling, scaring people just by being around.

Because of this, I never wear the hood of my hoodie. In general I have to wear as unthreatening clothes as I can. And I avoid dark streets, because someone can see me as a threat and fear makes people do irrational things.

We would all benefit from less fear.