Keeping Calm: When Distributed Consistency Is Easy

Re:Keeping Calm: When Distributed Consistency Is Easy by rektide on Tuesday October 13, 2020 @01:17AM (#24762496)

I continue to want to dabble here-abouts, since at least the time of having seen "Anna: A Crazy Fast, Super-Scalable, Flexibly Consistent KVS"[1], which is now one[2] of the two major components of the Hydro project, alongside Cloudburst[3], a Python "stateful serverless platform". There's also some other pieces like a local Anna-cache[4] & a coordinated retry library, & kubernetes-centric cluster-manager.

I have no idea how related the Hydro-Project work is to this recent publication on Calm, but I hope to find out!

[1] https://rise.cs.berkeley.edu/blog/anna-kvs/

[2] https://github.com/hydro-project/anna

[3] https://github.com/hydro-project/cloudburst

[4] https://github.com/hydro-project/anna-cache

[ Parent | on HN ]

Re:Keeping Calm: When Distributed Consistency Is Easy by tjungblut on Tuesday October 13, 2020 @03:29AM (#24763155)

I think this is highly misleading. They state that they achieved high speed-ups from not doing any coordination because they encode each state as a "private field" in an actor. Actors then communicate via queues (assume ZeroMQ from their reference), which require coordination to scale at some point - so do the actors that contain the actual data.

I do see some market for (eventual/in)-consistent databases though, so maybe that's something we are going to see much more often in the future.

[ Parent | on HN ]