Working with Apache Spark: Highlights from projects built in three weeks

Posted by ddrum001 on Friday March 13, 2015 @12:00PM
from the insightdataengineering.com dept.

http://www.insightdataengineering.com/blog/Working-With-Apache-Spark.html

( 6 comments | 24 points | on HN )

Re:Working with Apache Spark: Highlights from projects built... by sampathweb on Friday March 13, 2015 @12:16PM (#9197935)

Really Nice set of projects. Would have also like to see a starter application with a mini tutorial on how someone can experiment with some of these technologies.

Github references on these projects would also have been useful. Thanks for sharing.

[ Parent | on HN ]

Re:Working with Apache Spark: Highlights from projects built... by phaefele on Friday March 13, 2015 @01:38PM (#9198458)

Did you consider Summingbird? Seems like a lot of what you are doing might have been simplified by using Summingbird rather than building separate speed and batch layers in Hadoop / Spark.

[ Parent | on HN ]

Re:Working with Apache Spark: Highlights from projects built... by ddrum001 on Friday March 13, 2015 @02:06PM (#9198714)

That's a great point for our next session - Summingbird would be perfect for everyone trying to implement Lambda Architecture without having to produce separate code for streaming and batch.

[ Parent | on HN ]

Re:Working with Apache Spark: Highlights from projects built... by PedroSena on Friday March 13, 2015 @02:51PM (#9199120)

Is the code available somewhere ? I'd love to see the one related to fantasy sports

[ Parent | on HN ]

Re:Working with Apache Spark: Highlights from projects built... by xbeta on Friday March 13, 2015 @04:12PM (#9199706)

Would love to try this! Thanks for sharing !

[ Parent | on HN ]

Re:Working with Apache Spark: Highlights from projects built... by shamino on Friday March 13, 2015 @01:58PM (#9198634)

Thanks for sharing! This is awesome!!

[ Parent | on HN ]