Re:Lesser-Known Python Data Analysis Libraries
by dguaraglia on Tuesday April 19, 2016 @10:53AM
(#11527389)
Unfortunately, no. We are slowly moving away to a streaming infrastructure, so I've been mostly trying to "keep it running" until we are done replacing it. Sorry.
[ Parent
| on HN ]
Re:Lesser-Known Python Data Analysis Libraries
by tanlermin on Tuesday April 19, 2016 @12:17PM
(#11527994)
Check out dask: http://www.slideshare.net/continuumio
Its free with a permissive license and actively growing.
It is also capable of native HDFS integration, Yarn etc and can do more complex and granular parallel patterns than just map reduce. Also has a API for distributed dataframes and arrays with linear algebra ops.
DISCLAIMER: I don't work for continuum. I just want to see its projects succeed because I was a user will benefit.