What you describe is an unbearable nightmare.
It was great for my first couple years here, when I really wanted to go deep into the field and learn all I could. I had my "become a well-rounded person" phase in college, so by my 20s I was happy to specialize deeply. It was less great for years 3-5, when I ended up meeting and marrying a non-techie. It's been good again for me now, founding a startup, because of the huge number of potential customers everywhere. There's a huge difference between an abundance mentality vs. a scarcity mentality that having a large number of customers/employees/investors nearby creates.
Half sounds like an underestimate, probably more like 80%.
All of the above is why I left the Bay Area. I love tech, but geez. It's like loving chocolate and living in a chocolate house eating chocolate for every meal. I got about 6 months into that before a switch flipped and it became the most aggravating, insufferable thing ever.
Contrast this with a city like New York where you also have publishing, finance, advertising as well as solid tech.
I used to live in Boston (which at the time was the #2 tech scene in the country, but has probably been eclipsed by Seattle/NYC/Austin by now). There were startups and meetups and hacker spaces as well, including a number of famous ones.
The Bay Area is a huge difference in degree. The difference is that you had to find the "tech scene" in Boston, while in Silicon Valley, tech is the scene. If you go out for coffee, nearly everybody in the coffeeshop will be working on some tech startup. If you sit down at a restaurant, there's a good chance that the table next to you will have a group of engineers from some large tech company, or an investor being pitched by an entrepreneur, or a group of friends planning a startup. If you go to a random party - even ones thrown by non-techies - half the people there will work in tech.