Summingbird – Streaming MapReduce with Scalding and Storm

Posted by freeslugs on Tuesday May 13, 2014 @10:23PM
from the github.com dept.

( 3 comments | 35 points | on HN )

Re:Summingbird – Streaming MapReduce with Scalding and Storm by juliangamble on Wednesday May 14, 2014 @12:06AM (#7742139)

There are a number of custom analytics approaches that have been used at Twitter. One of the authors of the Summingbird framework, Sam Ritchie - has also worked on Cascalog (Clojure mapreduce library).

You can see a presentation about a Clojure solution in Cascalog to a similar set of problems by Sam Ritchie here: "Cascalog 2 - Streaming MapReduce in Clojure" https://speakerdeck.com/sritchie/cascalog-2-dot-0-datalog-in...

[ Parent | on HN ]

Re:Summingbird – Streaming MapReduce with Scalding and Storm by phaefele on Wednesday May 14, 2014 @01:18PM (#7744844)

After building a large Hadoop simulation environment and contemplating how to use the same codebase in a streaming fashion, Summingbird seems like an exciting answer. I am concerned that I don't see much discussion around its use online and wonder what its adoption is like. Are people using it? I wonder if the usage of new terms like "moniod" scares people away.

[ Parent | on HN ]

Re:Summingbird – Streaming MapReduce with Scalding and Storm by venantius on Wednesday May 14, 2014 @12:37AM (#7742227)

Not to be negative, but I'm not sure why this is on HN - Summingbird has been open source for most of the last year.

[ Parent | on HN ]