Now some might _choose_ to move because they could sell their single-family home for a much higher price to someone who would then build a multifamily building on the lot. But that's obviously their business.
But to the main point of your argument, about happiness: it's a general truism that people in low-density-zoned areas are happy there and oppose any sort of upzoning anywhere nearby. Upzoning nearby but not on their actual lot is particularly bad, because it would reduce the value of their real estate; people fight _that_ tooth and nail.
The result is that everyone who is already there is fine; it's people who are trying to enter the market, either via moving to the area or by growing up and trying to move out of their parents' house, who get screwed. But since by and large those people don't vote (the young for demographic reasons; the not-yet-residents because they're not yet residents), it's the incument residents who get to control the zoning rules to their exclusive (perceived, at least) benefit.
Which is all fine, but then prices get out of hand and people panic and start introducing things like rent control and whatnot, which makes prices get even more out of hand anytime someone actually moves. And then we see the current San Francisco real estate market.
People fight upzoning because they like where they live, and upzoning would destroy what they like about it.
As for "people trying to enter the market", upzoning makes it that much harder; condos are generally a worse investment, so most high-density developments are rentals. If you think housing prices are high, try the cost of a buying a rental building.
Lastly, the "incumbent residents" bit is hilarious. I believe that's called "a citizen", or "a community member" -- as in, the people who are paying the taxes and electing representative leadership to serve in the interests of their established community.
You didn't read what I said carefully enough. People fight _nearby_ upzoning because it reduces the value of their real estate. Upzoning of their actual land increases its value, of course.
Agreed on people fighting upzoning of their own land because it would change the surroundings in a way they find undesirable.
By "people trying to enter the market", I mean the housing market, not the real estate purchase market. That is, people trying to find a place to live. It's quite rare for people first moving out of their parents' house to do so by buying a house themselves; they typically rent. The result is that there are tons of places in the US (including San Francisco) where people have to move far away from their relatives when they move out on their own because there is nowhere nearby that is a viable place to live.
As for that last.... that's true if you exclude the interests of the children of the community (which are nearly always excluded; once the kids finish college they're on their own and typically shut out of the community). It's also true if you ignore the fact that some of these communities (and the Bay Area is particularly bad about it) try to create lots of employment opportunities but without the corresponding housing. This leads to hellish commutes for everyone, including the members of the community in question, lots of complaining, and poorer quality of life than you would have otherwise.
There are some unpleasant tradeoffs here, for sure. The problem is that some people refuse to acknowledge that the tradeoffs even exist and to discuss what the right tradeoff is. They insist that nothing must ever change, period, and it never occurs to them that this means that their commute will suck more and more and their kids will not be able to live near them.
Note that I say this as someone who lives in a suburb. I like it here. I would not be terribly happy with upzoning myself. And yet I'm watching a lot of the resulting problems play out (including people who grew up in the town being completely priced out of it). It's not pretty, and upzoning sure would help some of those problems.
Many such people would be pretty happy to have an independent one bedroom apartment in a 5 story building in the same neighborhood at a similar price, assuming some improved transit.
Personally, I also think a lot of land west of Twin Peaks is underutilized. But I think it's important for people not to be glib about the fact that a lot of the people living there think it's just fine, and that even for those who want something different we're talking about incredibly disruptive and expensive change.
How are you finding that has worked out for SF overall?
And two, I think things are working out reasonably well for SF. The US has a history of absolutely terrible attempts at grand redevelopment. Read up on our "urban renewal" waves, for example. San Francisco has mostly avoided or repaired that sort of urban planning idiocy, and I think it would be monumentally dumb to let another bubble lead to big "solutions" to problems that are transitory.
If you and others would like to indulge that third-world dictator tendency to dramatic urban planning, might I suggest finding someplace else in the Bay Area? San Francisco is less than 1% of the land; there's no particular reason to do it here. Or, better, show us how it's done in, say, Texas, which has plenty of space to develop that nobody is currently occupying.
If you think that then I have a bridge to sell you. A nice International Orange one.
SF is a hive of planning idiocy, from dumb height laws, to 1:1 parking requirements, to terrible permit application processes. It's practically a model for planning idiocy at this point.
Assuming you do, then I guess this is just more spleen venting. Anonymous spleen venting of course; I imagine you wouldn't act this way in person: http://www.penny-arcade.com/comic/2004/03/19
If you want to see the cause for "the problem SF has had for nearly 30 years now", look in the mirror.
I wrote this more than a year ago: https://www.quora.com/Why-are-some-San-Francisco-residents-a...
As far as I can tell, the willful obliviousness is just as bad as then, and maybe worse.
It's not true, but it sounds right if you don't look too close.
The tech industry isn't the cause of anything but growth. Growth isn't bad. Growth is totally manageable. It's not like these issues magically showed up in the tech boom of the 90s - it just made them worse.
However what DID cause this: bad urban planning, lack of ability to change, being systemically unable to fix the housing issues over the last 40 years.
Plenty of places cope with growth periods better than SF, but SF doesn't want to cope with them: it wants to have it's cake and eat it too. It can't, but it's been trying for a long time and failing horribly.
This is not a new development. It's not a new problem. The solutions have been the same for a long time but no-one wants to change to fix them.
It appears we both agree that rapid growth is a proximate cause of the problem, and the tech industry is the main cause of that rapid growth. Where we differ is that you think a bunch of other people should immediately change to accommodate you, while you simultaneously refuse to acknowledge their perspective, which is that their previous system was working well enough for them until tech people came along in overwhelming numbers. And that maybe they were perfectly happy with how things are, and feel no particular need to change to suit you.
The rest looks like dickish handwaving to me. If you'd like to just keep yelling at people, stop bugging me. If you'd like to have an actual discussion, then start behaving respectfully.
IIRC, one of the notable things about SF in the .com burst was that housing prices did not drop significantly (as they did in outlying areas of the Bay Area), the rate of increase just dropped, as the people who still had good-baying SF jobs moved in from the peripheries and replaced the people who could no longer afford SF because they fell off the gravy train.
http://www.citylab.com/housing/2013/10/san-franciscos-fluctu...
My recollection is that housing rental was in between.
It's worth noting that the dot-com bust hit tech hard, but didn't do anything to housing nationally. So it's hard to separate the effect of the dot-com bust with the housing bubble that was starting to inflate at the time. And thinking about who I know who bought property right after the bust, it was people who made money in the previous bubble, which would also have a masking effect.
Just conservative and regressive selfish fools with no ability to look at the bigger picture to help their fellow man (and themselves)