They already often have very large trucks that only go to warehouses, and would be a pain to drive through a city, especially such an old and super-dense one as NYC.

Smaller trucks move smaller quantities around the city from the warehouses.

Maybe sometimes you need to bring something especially large e.g. for a construction; such deliveries may be special-cased and planned carefully, instead of being completely off-limits.