News for hackers. Stuff that matters.

A comment on Don't use Hadoop when your data isn't that big (2013). Parent comment

Re:Don't use Hadoop when your data isn't that big (2013) by lars_francke on Tuesday May 23, 2017 @11:56AM (#14402282)
> Spark is orders of magnitude faster than Hadoop, too.

A comparison between Spark & Hadoop doesn't make much sense though.

Spark is a data-processing engine.

Hadoop these days is a data storage & resource management solution (plus MapReduce v2). Spark often runs on top of Hadoop: Hosted by YARN accessing data from HDFS.

[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by minimaxir on Tuesday May 23, 2017 @12:13PM (#14402458)
Spark compares itself to Hadoop in its own marketing: http://spark.apache.org
[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by rocmcd on Tuesday May 23, 2017 @12:22PM (#14402550)
There's a subtle difference between Hadoop (the platform / ecosystem) and Hadoop MapReduce (tasks that run on Hadoop). It's the latter that is being referenced in the comparison.
[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by minimaxir on Tuesday May 23, 2017 @12:26PM (#14402594)
Fair distinction.
[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by lars_francke on Tuesday May 23, 2017 @12:23PM (#14402557)
Yes, but that still doesn't make much sense. That particular part of the homepage hasn't been updated in ages and refers to the MR part.

As you said: Marketing :)

[ Parent | on HN ]