Of course there's something lost. If I see my colleague's local time will be 9:00PM, I know not to schedule a meeting then. It's a method for translating familiar associations of hours across space.

Also, and more importantly, "it's 5:00 somewhere!" would cease to be true.