I live in midtown manhattan (46th & 2nd) and while I don't enjoy it quite as much as I did living downtown it's still pretty great. I've no idea why you think it would be miserable.