I think rent control a is a big reason why this attitude exists. A large segment of rents (~70% of them) live in rent controlled units, and thus have no direct incentive to lower rents. In practice, most people probably wouldn't pay hundreds or thousands of dollars extra per month for a better view. But in SF, residents are shielded from that sort of tradeoff by rent control, and the costs of obstructing development are passed off to other people. If residents actually felt the impact of rising rents, the discussion around development would be a very different story.

In cities without rent control, like Seattle, development happens a lot quicker. Over the course of half a decade (2010-2015 IIRC) Seattle added more than twice the number of housing units as SF. Rent control's perverse system of incentives leads cities like SF to shoot themselves in the foot.