SV is the best place to be, if what you are building doesn't have a clear market, or the market requires larger company's muscles.
The bottom line, they have millions in the bank, and you don't (ok, maybe you do, I don't know you).
If you plan to build some cool technology, and want to flip it to somebody else, that has the means to monetise it, the SF Bay area is the place to be.
If you want to build something small, and more of a traditional company, then a low cost area might make sense.
But have no boubt about it, some of the best talent is the bay area. It is like the Hollywood for geeks. The place where you can make it big. The place where the gold rush mentality will always prevail, as the people are drawn in here to make it big.
It seems that Web. 2.0 is out, and Green Tech is in. That's the new current bubble.
(yes, we do make money)
(and yea, I worked in a Prince quote!)
Take a look at the map of where Southwest Airlines flies to and you get a feel for 'alternative' cities that should have enough infrastructure for a startup.
In my neck of the woods, albany,ny we were the excitement of the entire area. We were on the front pages of the local paper all the time. Recruiting was easier because people knew who we were and understood we paid less, but had the excitement they were seeking.
We got free legal advice because lawyers wanted to be associated with us. We won local business plan competitions ($100k cash). We got investment from local VC's wanting to build up the area.
We paid $1500 a month in rent, including all utilities, for a mansion on the hudson river (and lived in the 5 bedrooms on the second floor). Our internet (cable modem) was $40 a month and screaming fast because our neighbors probably didn't even have it.
That helped us 'stay alive' long enough to figure out how to make money.