In that situation I just cross the street or turn down another street or whatever. One less thing for her to worry about and I avoid being thought of as a potential rapist. I wouldn't say it's a fear-based thing, though. It's more about avoiding a situation which is uncomfortable and awkward for both parties, however fleeting.

Honestly, what were you thinking about when you looked at her?

'Hmm, she's dressed nice, I wonder if she's going to the blues club? Gee, this is awkward. Oh no, she's kind of looking at me out of the corner of her eyes and reaching into her purse...'

You trying to imply I was being uncouth?