How we implemented replication in Memgraph DB – Our approach and challenges.

Re:How we implemented replication in Memgraph DB – Our appro... by antonio2368 on Wednesday February 10, 2021 @10:37AM (#26090554)

Well, consistency and availability are the problem here. While enforcing one of the property, you lose on the other. Not sure how would you achieve those opposing properties without introducing huge amount of complexity.

In this case, replication consists of communication between 2 instances, and when one them fails you need to pick consistency or the availability.

Paxos and Raft introduce consensus using multiple instances communicating with each other to mitigate those problems. Implementing correctly communication with 2 instances is hard enough, implementing it correctly for n instances is for sure harder.

In Memgraph, we actually tried to implement Raft and we did manage to some degree, but the effort was too much, especially when you look at the results we got (protocol that didn't work for many edge cases).

[ Parent | on HN ]

Re:How we implemented replication in Memgraph DB – Our appro... by macintux on Wednesday February 10, 2021 @12:03PM (#26091776)

Any chance you’ll have aphyr take it out for a spin with Jepsen?

[ Parent | on HN ]

Re:How we implemented replication in Memgraph DB – Our appro... by mbuda on Wednesday February 10, 2021 @02:08PM (#26093386)

We'll probably put the replication feature in the Memgraph Community soon. At that point, we'll make a PR to the Jepsen repo with all our tests included + yea, additional testing will be possible. That's always good. As they say, once you wrote a bunch of tests for your code, please leave it to the others to test it as well :D

[ Parent | on HN ]

Re:How we implemented replication in Memgraph DB – Our appro... by cpard on Wednesday February 10, 2021 @12:50PM (#26092432)

thanks for the detailed response. Did you try to implement Raft yourself or use something like etcd for coordination? It would be great to write about this journey too in the future.

[ Parent | on HN ]

Re:How we implemented replication in Memgraph DB – Our appro... by mbuda on Wednesday February 10, 2021 @01:59PM (#26093293)

We implemented Raft as a C++ library from scratch. We can probably publish that as s standalone implementation (open-source it). The main problem was the write performance and network communication overhead, even for read queries. There are some known solutions for all that. None of the Memgraph users required Raft type of guarantees, so we decided to go with a more straightforward and faster solution. It doesn't mean we won't get back to Raft in the future if required :D

[ Parent | on HN ]

Re:How we implemented replication in Memgraph DB – Our appro... by cpard on Wednesday February 10, 2021 @02:55PM (#26093856)

open sourcing such projects is always a good thing :)

[ Parent | on HN ]