Or Boston. We've got a thriving startup community and we've got tons of techie schools in the area!
There are even some groups who are going around to find all the local resources in the boston area: http://greenhornconnect.com/ and http://dartboston.com/
Manhattan is expensive. NYC as a whole isn't as bad.
Startups looking for a home: Take a look at D.C. IMO the talent base is every bit as rich as NYC's, and people can actually afford to live here.