Aside from a few historically sleazy streets/areas in the past, I don't really associate those sorts of sharp boundaries with Manhattan nearly as much as I do some other cities, especially in the South. (Though, for obvious reasons, apartment buildings/condos across from Central Park tend to be higher-end than those east of there.)