News for hackers. Stuff that matters.

A comment on Scikit-learn: machine learning in Python. Parent comment

Re:Scikit-learn: machine learning in Python by SoCool on Wednesday December 26, 2012 @09:40AM (#4969322)
Yes. it can. Scikit-learn supports algorithms that can be used to build your own recommender system. To scale your algorithms you can always use hadoop map/reduce to scale.
[ Parent | on HN ]
Re:Scikit-learn: machine learning in Python by axiak on Wednesday December 26, 2012 @10:26AM (#4969510)
Once you use scikit-learn to figure out what you want to do on a reasonable data set, you can use Mahout (http://mahout.apache.org/) to translate the algorithm to hadoop pretty easily.
[ Parent | on HN ]
Re:Scikit-learn: machine learning in Python by ogrisel on Wednesday December 26, 2012 @11:03AM (#4969655)
You should directly use Mahout: the recsys part is quite complete and high level and application oriented contrary to scikit-learn which does not provide high level recsys concepts.

The best documentation I found is the Mahout in Action book (http://manning.com/owen/) while reading the source code in parallel.

Also you probably don't need to run this on a Hadoop cluster unless your data is too big to fit on one single machine.

[ Parent | on HN ]