News for hackers. Stuff that matters.
Re:Distributed systems primer by Maro on Monday May 04, 2009 @05:08PM (#593077)
This post is full of errors. For example, Paxos is not about the Byzantine General's problem, Paxos is a consensus algorithm for the non-Byzantine case.
Re:Distributed systems primer by evn on Monday May 04, 2009 @05:23PM (#593110)
I fixed it, thanks. What other mistakes did you see?
Re:Distributed systems primer by Maro on Monday May 04, 2009 @05:47PM (#593148)
It still reads "Basic Paxos handles a single failure; it can be extended to handle multiple untrustworthy nodes (the Byzantine generals problem)." which is incorrect.

The correct statement is "Paxos handles the failure of a minority of nodes" or "Paxos can make progress if a majority of nodes is alive and connected". Paxos does not deal with nodes that do not follow the protocol (ie. lie, have been hacked, etc, this is what 'byzantine' means). Paxos only deals with non-byzantine failure.

Re:Distributed systems primer by evn on Monday May 04, 2009 @05:58PM (#593168)
Removed the reference to Byzantine generals and used your language for basic Paxos; clarified Tokyo Cabinet.

Thanks, let me know if there are other issues.

Re:Distributed systems primer by evgen on Tuesday May 05, 2009 @01:54PM (#594425)
Lamport's version of Paxos does not handle Byzantine failure, but later variations of it manage with an increased number of communication steps and a (n+3f)/2 valid acceptors requirement (where n is the total number of participants and f is the number of faulty participants).
Re:Distributed systems primer by Maro on Monday May 04, 2009 @05:42PM (#593136)
Tokyo is a KV store, but it's not a distributed KV store, so saying it is an alternative to Amazon Dynamo is misleading.
Re:Distributed systems primer by evn on Monday May 04, 2009 @08:44PM (#593376)
Yeah, you need something like http://opensource.plurk.com/LightCloud/ to make it actually distributed. It does support replication though.
Re:Distributed systems primer by Maro on Monday May 04, 2009 @08:55PM (#593390)
Yes, but its replication is similar to BDB's, a kind-of add-on/feature. It's not a full-blown replicated KV store like Google's Chubby with strong consistency, automatic failover, etc. Of course, not everybody needs that, I'm just saying...
Re:Distributed systems primer by benburkert on Monday May 04, 2009 @07:53PM (#593329)
Tokyo Tyrant can be used to build a distributed KV store with Tokyo Cabinet.

http://tokyocabinet.sourceforge.net/tyrantdoc/

Re:Distributed systems primer by Maro on Monday May 04, 2009 @08:29PM (#593358)
Tokyo Tyrant is a network wrapper around Tokyo Cabinet, meaning it translates commands coming from the network to local db calls. In itself Tokyo Tyrant is not a a distributed KV store. Sure, it can be used to build one, but so can BDB, Mysql, or just about any other piece of software which takes data from the network and stores it on disk.

The part that actually coordinates all the different network wrappers to work in unison is what makes a software "distributed".