News for hackers. Stuff that matters.

A comment on Command-line Tools can be 235x Faster than a Hadoop Cluster (2014).

Re:Command-line Tools can be 235x Faster than a Hadoop Clust... by jakosz on Wednesday May 23, 2018 @07:21PM (#17139390)
You can get very good improvements over Spark too. I've been using GNU Parallel + redis + Cython workers to calculate distance pairs for a disambiguation problem. But then again, if it fits into a few X1 instances, it's not big data!
[ Parent | on HN ]

There are no comments on this comment yet.