California has such a mild climate, that you can build a house out of ticky-tacky, skip the insulation, and people won't care because they have a lemon tree growing in their yard.
Nowadays code won't allow you to skip insulation (or solar), but with earthquakes and high land prices you still aren't getting stone or brick homes.
Structural stone and brick homes aren't really a thing in the US that much any more.
Beyond seismic issues, when it comes to insulation and efficiency and air/water leaks, homes built using bricks and stone are terrible, because those materials are very difficult to seal.
Most newer homes that have brick or stone exteriors use it only for aesthetics, and do not rely on it for structural integrity or resistance to the environment. Their actual skeletons are wood frames, and the weather resistance is provided by layers of materials over that.
You can build incredibly sturdy homes with wood - not ticky-tacky at all.
https://www.energy.gov/energysaver/energy-efficient-home-des...
Genuine question - when you're in the bay, do you spend time in any of the following: Pac Heights / Presidio Heights / Seacliff / Woodside / St. Helena / West Palo Alto / Stanford's Campus / Saratoga?
I think the reason you have the perception that you do is that the bay area is one of the least tourist-friendly locations in the world, frankly because the class you talk about loathes outsiders.
EDIT: A great microcosm of this is Sand Hill Road. Looks like less than nothing from the street, but it's home to some of the most expensive and nicest office real estate in the world. Apple HW stands out as another great example.
With RHNA (and state law attempts like SB50) this may be starting to change, but the people responsible for the economic success are not the ones with the political power to fix housing policy.
Most of these issues stem from bad housing policy and incumbents restraining supply.
Somehow SV just decided to not bother with that at all.