We've several thousands of nodes in our system. Our ops people have witnessed clock skew from seconds to months that are transient. Time is constantly synced via ntpd.

You can't trust system clocks in a distributed system to ensure ordering. Some reading:

https://codeburst.io/why-shouldnt-you-trust-system-clocks-72...