It's different in SF. The homeless are much more "in your face" than in any other city I've been to by a long shot e.g. in NYC the homeless mostly keep to themselves and aren't very aggressive in my experience. In SF they are very aggressive, many with mental issues, talking to themselves or yelling at others, and appear to be on drugs. I've never visited a city where they are so many homeless who are simply passed out in the middle of the sidewalk on the hard ground with people in suits stepping over them downtown. It's also more "visible" because services that cater to homeless are all located downtown.

I live in Castro, but obviously like many spend a lot of time downtown for work.

Sure, there are families in the outer neighborhoods, but it's different in the sense that those are mostly families that have lived in SF for generations. Good luck trying to raise a family as a newcomer on the reported median household income for SF of ~$78k.