News for hackers. Stuff that matters.
Re:Riak at Braintree by Ixiaus on Tuesday August 14, 2012 @09:38PM (#4383986)
SERIOUSLY! Riak is NOT MEANT for single-node clusters!!! It gets faster THE MORE NODES YOU ADD.

The minimum recommended number of nodes is 3; the "ideal" minimum number of nodes is 5.

Re:Riak at Braintree by stock_toaster on Tuesday August 14, 2012 @09:50PM (#4384024)
yes, with n_val=3 (default) 3 nodes is the minimum. I was merely testing (actually had 3 riak instances on a single box as a "cluster") but with r,w=1 and n_val=1 it was about the same (slow), which was disconcerting. cpu was very high in one instance (others were nearly idle, and IO was low. I did not try dw=0 though (if that would even work). Might be worth a try.

I am going to try bitcask too, to see if eleveldb was the culprit and could be tuned.

Re:Riak at Braintree by Ixiaus on Tuesday August 14, 2012 @10:32PM (#4384169)
Your test isn't valid if it was all on one box - the disk I/O is going to be really nasty with that. Your test would be better on three different machines.
Re:Riak at Braintree by stock_toaster on Tuesday August 14, 2012 @11:56PM (#4384507)
The disk io was pretty low. It is serial get/update/delete (as I mentioned earlier). I even tried moving the data dirs to ramdisk (was plenty of ram), but it didn't help much at all. i/o was certainly not the problem.

It very well could be a configuration issue. I am still trying a few things to see if I can get an improvement.

Re:Riak at Braintree by pharkmillups on Wednesday August 15, 2012 @10:11AM (#4386002)
If you haven't done so already, I would highly-recommend taking a look at Basho Bench, our open source benchmarking tool for Riak.

http://wiki.basho.com/Benchmarking.html https://github.com/basho/basho_bench

Re:Riak at Braintree by stock_toaster on Wednesday August 15, 2012 @01:41PM (#4387118)
thanks. Will do!
Re:Riak at Braintree by Ixiaus on Wednesday August 15, 2012 @12:50AM (#4384638)
Interesting. I can vouch for the speed of leveldb on a five node cluster - I'm using it in our startup on 5 dedicated machines with around 12GB of RAM, running on FreeBSD. Riak version is 1.1.4; Riak 1.2 is supposed to have a lot of leveldb refinements.
Re:Riak at Braintree by stock_toaster on Wednesday August 15, 2012 @01:44PM (#4387129)
Good to hear. I will keep poking at things. I probably have something misconfigured or an issue with how I am using the python client.

Thanks.