News for hackers. Stuff that matters.
Re:Tango: Distributed Data Structures Over a Shared Log (2013) by andr on Sunday November 13, 2016 @01:19PM (#12944700)
Sounds like a low-level implementation of event sourcing/CQRS. Is there anything similar that is usable right now? Perhaps built on Kafka?
Re:Tango: Distributed Data Structures Over a Shared Log (2013) by morsch on Sunday November 13, 2016 @02:28PM (#12945118)
We're using eventuate[0], which is an event-sourcing framework with deep support for cooperation via shared logs. It's based on the actor framework akka; akka itself has akka-persistence[1], which is similar but different[2]. All of these techs are usable right now.

Though it doesn't feature either implementation (he does something similar on top of Samza), I like this article[3] on the topic: turning the database inside out really is what we're doing.

[0] http://rbmhtechnology.github.io/eventuate/

[1] http://doc.akka.io/docs/akka/snapshot/scala/persistence.html

[2] http://krasserm.github.io/2015/05/25/akka-persistence-eventu...

[3] https://www.confluent.io/blog/turning-the-database-inside-ou...

Re:Tango: Distributed Data Structures Over a Shared Log (2013) by noahdesu on Sunday November 13, 2016 @02:11PM (#12945006)
We have built an implementation of CORFU [1] (the protocol Tango is based on) that runs on Ceph/RADOS, called ZLog [0]. We have a very simple prototype of Tango running ZLog. ZLog could run on other storage systems like Kafka but we have only focused on Ceph/RADOS as the underlying storage.

[0]: https://github.com/noahdesu/zlog

[1]: https://www.usenix.org/conference/nsdi12/technical-sessions/...

Re:Tango: Distributed Data Structures Over a Shared Log (2013) by aji on Sunday November 13, 2016 @05:34PM (#12946102)
Apache Samza, also from LinkedIn, is built on Kafka and I think could be used to do something like this