Basing your experience in SF on what happens on Market Street is like going to LA and basing your experience on visiting Skid Row. The vast majority of the city is just not like that. If you run into resistance from people who live here when recounting experiences like this, it’s probably because your statement is one that doesn’t pass the smell test, it seems plainly like you’re being willfully misleading. Next time you come to SF, I recommend reading a travel guide and staying somewhere that isn’t Market Street. Public transit is good enough that you can do that, your experience will be much more enjoyable.