The problem in SF isn't that people want to live in different areas. The same is true in NYC or Chicago. The problem is that there isn't proper zoning. To make transit feasible, you need an extremely dense central business district with a ton of office space. You need employers to be mostly in the same core area. Then, you need to zone things and lay out transit stations so they're approachable for pedestrians. Too many systems make transit stations into these isolated intimidating affairs.
This is a neighborhood in Chicago with a lot of young families: http://maps.google.com/maps?q=Paulina,+Chicago,+IL&hl=en...
Tree lined streets and small yards. Just a couple of minutes walk from the train stations. Just pan around and you can see the train tracks passing right through.
Train stations in Chicago are extremely easily accessed from street level. No parking lots, no elaborate station house, just stairs and a platform: http://maps.google.com/maps?q=Sedgwick,+Chicago,+IL&hl=e...
Most of Europe (and some of Asia) is beautiful with respect to transit, density, and quality of life. I hope we (as a country) move in this direction, but it really requires a change in our value system.
But I agree on the last point; but offices should be built where people want to live, not the other way around. Twitter is in SF for a reason. But then people don't all want to live in the same place; some have kids and prefer suburbs, some are younger and prefer the city.
Edit: facebook -> twitter. (face plant)