News for hackers. Stuff that matters.
Re:Scalability, but at what cost? (2015) by cle on Tuesday June 07, 2016 @02:25PM (#11856562)
> The only advantage of clustered systems like Spark, Hadoop, and others is aggregate bandwidth to disk and memory.

Also, aggregate network bandwidth. A major use case for clustered processing is that it is MUCH faster to download external data in parallel across a cluster than in parallel on one box. If timeliness is a major use case of the system you're building, this basically requires a cluster, unless you want to end up re-implementing cluster functionality yourself.

There are no comments on this comment yet.