Re:Tango: Distributed Data Structures Over a Shared Log (2013)
by andr on Sunday November 13, 2016 @01:19PM
(#12944700)
Sounds like a low-level implementation of event sourcing/CQRS. Is there anything similar that is usable right now? Perhaps built on Kafka?
[ Parent
| on HN ]
Re:Tango: Distributed Data Structures Over a Shared Log (2013)
by morsch on Sunday November 13, 2016 @02:28PM
(#12945118)
We're using eventuate[0], which is an event-sourcing framework with deep support for cooperation via shared logs. It's based on the actor framework akka; akka itself has akka-persistence[1], which is similar but different[2]. All of these techs are usable right now.
Though it doesn't feature either implementation (he does something similar on top of Samza), I like this article[3] on the topic: turning the database inside out really is what we're doing.
[0] http://rbmhtechnology.github.io/eventuate/
[1] http://doc.akka.io/docs/akka/snapshot/scala/persistence.html
[2] http://krasserm.github.io/2015/05/25/akka-persistence-eventu...
[3] https://www.confluent.io/blog/turning-the-database-inside-ou...
Re:Tango: Distributed Data Structures Over a Shared Log (2013)
by noahdesu on Sunday November 13, 2016 @02:11PM
(#12945006)
We have built an implementation of CORFU [1] (the protocol Tango is based on) that runs on Ceph/RADOS, called ZLog [0]. We have a very simple prototype of Tango running ZLog. ZLog could run on other storage systems like Kafka but we have only focused on Ceph/RADOS as the underlying storage.
[0]: https://github.com/noahdesu/zlog
[1]: https://www.usenix.org/conference/nsdi12/technical-sessions/...