News for hackers. Stuff that matters.
Re:Every System is a Log: Avoiding coordination in distribut... by ismailmaj on Friday January 24, 2025 @01:26PM (#42815793)
In case of mutation either the replicas will be out of sync (so no C), or you'll need to synchronously mutate the replicas (so bad A due to latency).
Re:Every System is a Log: Avoiding coordination in distribut... by UltraSane on Friday January 24, 2025 @01:49PM (#42815964)
delaying writes by a factor longer than the max clock skew of the cluster is a pretty common strategy. It is what Google Spanner does.
Re:Every System is a Log: Avoiding coordination in distribut... by ismailmaj on Friday January 24, 2025 @02:05PM (#42816077)
Right but it's not magic as you cannot predict networking delays.

The max clock skew also has to pick between A and C, in underestimates you lose serializability, in overestimates you pay in write latency.

Re:Every System is a Log: Avoiding coordination in distribut... by UltraSane on Friday January 24, 2025 @02:50PM (#42816374)
What if you use CockroachDB for your log? They do something pretty clever: https://www.cockroachlabs.com/blog/living-without-atomic-clo...
Re:Every System is a Log: Avoiding coordination in distribut... by ismailmaj on Saturday January 25, 2025 @07:57AM (#42821367)
Thanks for the link, not much familiar with CockroachDB but I worked on a similar system that wanted to provide strong consistency when reading from many databases, some of which where Spanner but not all of them.

Eventually the system implemented something similar to "find transaction timestamp at execution time" + optimistic locking, as the article states you lose global linearizability and have to do some re-reads for writes.

What I missed the most from Spanner compared to the system above is that its tricky to do client-side transaction chaining where there are many clients and the order is important.

Re:Every System is a Log: Avoiding coordination in distribut... by UltraSane on Saturday January 25, 2025 @09:28AM (#42821842)
If you put a atomic clock like OCP-TAP Time Card with GNSS receiver in every server and use precision time protocol to sync them you should be able to synchronize quite a few servers to less than 100 nanoseconds.