News for hackers. Stuff that matters.

A comment on NewSQL databases fail to guarantee consistency and I blame Spanner. Parent comment

Re:NewSQL databases fail to guarantee consistency and I blam... by ultraluminous on Friday September 21, 2018 @04:57PM (#18042609)
There's a substantial difference between High Availability (HA) clustering and Load Sharing (LS) clustering. In an HA cluster a production database can run on a single active node while replicating to a separate standby node. Network partitions will cause a lag in replication but will not present an external consistency issue as there's still only one active node at any time. When the partition is resolved the replication catches up and all is right with the world. Which is to say, you can scale vertically while having both reliability and availability.

Hard "distributed systems" problems in databases generally only creep up when you're trying to deploy a multi-active system.

[ Parent | on HN ]
Re:NewSQL databases fail to guarantee consistency and I blam... by joemag on Friday September 21, 2018 @05:46PM (#18042893)
Agreed that such setups can be simpler than multi-master replication. Yet, there's still a hard distributed systems challenge even in the active/passive setup like you describe. When a failure occurs, the clients need to agree which host is the master and which host is the slave. And in the presence of network partitions, it can be impossible to say if the old master is dead, or partitioned away, and hence still happily taking writes.

The most common way in which such systems failover is by fencing off the old master prior to failover. Which in itself can be a hard distributed problem.

[ Parent | on HN ]
Re:NewSQL databases fail to guarantee consistency and I blam... by ultraluminous on Saturday September 22, 2018 @09:17PM (#18048891)
You can also just configure the client to point to a single db node and have an applicative monitoring based update to the db connection string upon failover. Then you're not actually dependent on your client loadbanacing logic. It's very robust and if you follow CQRS also highly available.
[ Parent | on HN ]
Re:NewSQL databases fail to guarantee consistency and I blam... by joemag on Saturday September 22, 2018 @09:47PM (#18048982)
Except propagating a configuration update to multiple clients, without a split brain is a hard distributed systems problem :). Especially in the presence of those pesky network partitions.
[ Parent | on HN ]