The calendar day being aligned to the sleep/wake cycle and changing when most of the population is either asleep or at least might not terribly care about the actual date does help quite a bit.

> Usually meetings are setup using an app and shared calendars should actually help here, a person can have meeting slots and out of office time, that should provide the same info. logistically I don't see that much of a difference from the current situation

It'd also wreck any time references in any kinds of stories that aren't consumed locally. So every time I read/watch/listen to a story that isn't set where I live, I'd first have to look up the local time to make sense of any time references.