It was a very deliberate decision in planning NYC not to have alleys.

This was for safety reasons: alleys provide many poorly-lit, poorly visible locations to commit crimes: mugging, illegal transactions (drugs etc.) and worse.

So just to be clear that alleys aren't necessarily a net benefit. New York may very well have been much safer, at the price of late-night garbage out visibly for pickup.