News for hackers. Stuff that matters.

A comment on Lesser-Known Python Data Analysis Libraries. Parent comment

Re:Lesser-Known Python Data Analysis Libraries by rch on Tuesday April 19, 2016 @12:24PM (#11528045)
I've been using Luigi for a few months, with no complaints. It supports running Python jobs on Hadoop and Spark, but it's not really a MapReduce framework unto itself.

However http://discoproject.org/ might be worth a look as a standalone alternative.

[ Parent | on HN ]
Re:Lesser-Known Python Data Analysis Libraries by sitkack on Tuesday April 19, 2016 @12:36PM (#11528139)
I have used Disco extensively in the past, nothing but good things to say about it. Fast job launch, easy to write, the DFS has been stellar. This was only using Python for job code.
[ Parent | on HN ]