Re:Clash of the Titans: MapReduce vs. Spark for Large Scale ...
by analytically on Tuesday October 06, 2015 @12:52PM
(#10340255)
4 node cluster??
[ Parent
| on HN ]
Re:Clash of the Titans: MapReduce vs. Spark for Large Scale ...
by bpodgursky on Tuesday October 06, 2015 @01:46PM
(#10340801)
This is a very valid concern. There are a lot of ways to make algorithms and distributed systems scale poorly for significant numbers of computation nodes (it took Hadoop half a decade to figure out how improve this via YARN).