News for hackers. Stuff that matters.
Re:Consistent Hashing by sdave on Saturday March 24, 2012 @10:18AM (#3749419)
trivia ex-Akamai-ite here: Danny Lewin was one of the co-inventors of this. RIP.(http://en.wikipedia.org/wiki/Danny_Lewin) link to original paper: http://www.akamai.com/dl/technical_publications/ConsistenHas...
Re:Consistent Hashing by notmyname on Saturday March 24, 2012 @01:10PM (#3749907)
A coworker of mine wrote a series of posts on how to build a consistent hashing ring and expand it with the concepts or weighted nodes and availability zones.

http://www.tlohg.com/p/building-consistent-hashing-ring.html

Those ideas for the core of the consistent hashing found in Openstack swift (a large-scale distributed object storage system).

Re:Consistent Hashing by slackerIII on Saturday March 24, 2012 @10:52AM (#3749506)
Ha, what a neat way to wake up -- my blog on HN. Thanks guys.
Re:Consistent Hashing by alexchamberlain on Saturday March 24, 2012 @03:24PM (#3750412)
Great post, any posts on control theory coming?
Re:Consistent Hashing by slackerIII on Saturday March 24, 2012 @05:28PM (#3750779)
I would love to, but I don't know that material cold like I do the other stuff, and I don't currently have the time to do that kind of research.
Re:Consistent Hashing by mthreat on Saturday March 24, 2012 @04:49PM (#3750680)
I remember someone pointing out your AudioGalaxy server cluster at the north austin datacenter (I think it's the one that became SunGard). I just said "wow". You still in Austin?
Re:Consistent Hashing by slackerIII on Saturday March 24, 2012 @05:23PM (#3750771)
Yeah, that was pretty cool for the time, at least until I had to unrack every single one and drive it back to our office. This is what it looked like after that:

http://www.tomkleinpeter.com/wp-content/uploads/2008/03/unra...

These days we are in Seattle.

Re:Consistent Hashing by harryf on Saturday March 24, 2012 @01:51PM (#3750039)
If you're using memcached, using consistent hashing is largely a matter of configuration on the client side (although it's worth understanding how it works and why you want it). Pretty much any memcached client that's built on libmemcached comes with it although most aren't using it by default; the overhead of calculating the ring is significant and needs to be thought about e.g where you store it - not something you want to do on every request.
Re:Consistent Hashing by jhaile on Saturday March 24, 2012 @03:37PM (#3750452)
redis also supports consistent hashing in many of its drivers (including the Ruby one). It also supports a nifty way to only use part of the key as the consistent hashing key so that you can ensure certain data is stored on the same server. For example, if you use the key "mydata-{123}" only the "123" part will be used by the consistent hashing algorithm. Of course, Riak is also a good example of consistent hashing.
Re:Consistent Hashing by jedberg on Sunday March 25, 2012 @05:29PM (#3753879)
It always boggles my mind that more people don't know this. Every presentation I give, I always try to put in a slide about consistent key hashing, because it is one of the easiest things to get right and yet something I see most everyone get wrong (including myself the first time around).