I absolutely love NY, but I think if I lived there I'd be too distracted by the glitz or too envious of all the rich i-bankers to do a startup.
I live in Boulder, which IMO has a the perfect combo of livability and talent & resources need to launch a tech company. It will never be Silicon Valley, but that also means it will never have the traffic. It's really nice to be able to walk or ride a bike to most meetings. And every day I seem to bump into fellow entrepreneurs while in line at the coffee shop a couple blocks from my office.
People tend to live in places convenient to their first job. Getting around for work is a nightmare unless you live in an area served by the right public transit connections.
Now if you are young/poor enough or rich enough to live in Manhattan, it's a magical place.
Also keep in mind that the industry clusters in NYC aren't what they once were. Finance is the king kong of NYC industry.
Silicon Valley had a totally different kind of industry cluster -- you had a torrent of Federal dollars flowing in for defense work, which ultimately concentrated technical talent and created all sorts of spinoff industrial activity. NYC is a great place to make money, but it isn't the same as SV.