News for hackers. Stuff that matters.
Re:Spark Breaks Previous Large-Scale Sort Record by rxin on Friday October 10, 2014 @08:42PM (#8440779)
Actually Doug Cutting himself (who created Hadoop) tweeted about this. I guess Spark gets some of his blessing :)

As pointed out in the article multiple times, we are comparing with MR here. We are not comparing with Hadoop as an ecosystem. Spark plays nicely with Hadoop. As a matter of fact, this experiment ran on HDFS.

In terms of vibrant community, Spark is now the largest open source Big Data project by community/contributor count. More than 300 people have contributed code to the project.

Re:Spark Breaks Previous Large-Scale Sort Record by gtrubetskoy on Friday October 10, 2014 @11:49PM (#8441181)
I remember Nathan Marz saying that Storm is the most active project on Github about a year ago. ;)
Re:Spark Breaks Previous Large-Scale Sort Record by nchammas on Saturday October 11, 2014 @04:23AM (#8441611)
That may well have been true a year ago, but it is not true as of a few weeks ago [1], and hasn't been true since around Spring of this year.

[1] http://youtu.be/zW0Pqfb8ij0?t=3m50s

Re:Spark Breaks Previous Large-Scale Sort Record by based2 on Sunday October 12, 2014 @07:41AM (#8445017)