News for hackers. Stuff that matters.
Re:R3, a map-reduce engine with Python and Redis by fsaintjacques on Thursday July 26, 2012 @05:11PM (#4298767)
Can you horizontaly scale the redis backend or it supports only one instance?

Why restrain to sequential reducers when you can parallelize with partitions and sorting?

Re:R3, a map-reduce engine with Python and Redis by heynemann on Sunday July 29, 2012 @10:38AM (#4308555)
We do horizontally scale redis as a farm. I'll try to get more details on how we do it as I'm not the one responsible.

We thought of parallel reducers and it does make a lot of sense. The reason they are sequential is to get a first release out so we can juggle ideas with people. If you care to contribute we'd love it. Even if you just create an issue.