For every person like you there's 500 dudes who want something from the stranger - their money, their body, etc. People are standoffish because they don't have the context that you do regarding the interaction and it's unclear which way it's going.