There are things that suck about SV, but there are great things too: the weather is extremely nice, lots of cultural diversity, good food scene, and there's so much tech that you have lots of opportunities and security.

But taking a cynical angle like yours, you could apply that reasoning to any big city in any country: why do they have to pay more? Well, obviously because people hate Tokyo/Paris/NYC/Milan/London/etc.