A lot of the balancing comes from development. It's rare for e.g. a city block to come together to demand better policies. When they do, it's often a NIMBYist backlash against productive policy. Developers, on the other hand, care about the impact of policies on their aggregate holdings. Since they're typically developing a pipeline, their NIMBYist instincts tend to be relatively dulled.
Everything seems to point in the same direction. Cities which refuse to grow, instead transferring the fruits of growth to a land-owning elite, fail.
Japan is one of the most crime-free countries in the world, because serious crime is monopolised by the criminals (and penalties for cutting their lunch are pretty heavy, which is common amongst most Asian gangs) and "respect" or "honour" is considered sacred. They don't romanticise or make "being an asshole" look fun or positive (ala "Wolf of Wall Street" is a perfect example).
http://www.theatlantic.com/magazine/archive/2015/03/the-mira...
tldr: the twin cities tax businesses and put the money into low income communities to prevent crime, and in the 70s and 80s, 70% of subsidized units were built in the wealthiest white districts, to prevent ghettos from forming.
And SF's particular flavor of idealism is carried to a remarkable extreme in the public arena.
The homeless (and others who are considered "marginal") get the benefit of the doubt from the police and society in general, even when they're pissing in the street.
This is a special kind of thinking which is specific to SF (and perhaps Berkeley and a small number of other cities). I don't believe such thinking is part of progressivism in general.
I was wrong.
But I also want to live in a city where I don't need to worry about my car getting broken into. Where I don't have to worry about being mugged late at night. Where the police department is adequately staffed to minimize crime, and those who do commit crimes are punished for doing so.
And call me an elitist, but I'd be very happy if my kids could grow up in a city where the streets are clean and don't smell of piss.
I don't see why any of those desires should be in conflict with my progressive ideals, but apparently in SF, that makes me a heartless capitalist pig. Whatever. Water under the bridge now. Best wishes to you SF. I'll just continue living here in my new home where people are willing to face up to real problems with practical solutions.