News for hackers. Stuff that matters.

A comment on Joining a billion rows 20x faster than Apache Spark. Parent comment

Re:Joining a billion rows 20x faster than Apache Spark by user5994461 on Thursday February 09, 2017 @04:21PM (#13611103)
If a distributed software running on multiple high end expensive servers cannot beat another solution running on a single laptop with a cheap external hard drives, the issue is not distributed systems, the issue is that that specific software is crap.
[ Parent | on HN ]
Re:Joining a billion rows 20x faster than Apache Spark by quantumhobbit on Thursday February 09, 2017 @04:50PM (#13611342)
There will always be some overhead, but yes it seems like some of these frameworks are pretty bloated.
[ Parent | on HN ]