Don't use Hadoop when your data isn't that big

Re:Don't use Hadoop when your data isn't that big by acidity on Tuesday September 17, 2013 @12:27PM (#6400230)

I have been looking into building simple recommendation engine (i have at max million data rows) using Python. I looked into Crab (https://github.com/muricoca/crab) and it seems to not have updated for 2 years.

Any suggestions for libraries or just use basic numpy/scipy and implement the algorithms?

[ Parent | on HN ]

Re:Don't use Hadoop when your data isn't that big by w_t_payne on Tuesday September 17, 2013 @04:37PM (#6401781)

Just implement the damn algorithms. Anything else is just another library to learn, and another tool to babysit.

[ Parent | on HN ]

Re:Don't use Hadoop when your data isn't that big by edraferi on Tuesday September 17, 2013 @11:46PM (#6403330)

Agreed. Take the Machine Learning class on Coursera if you need an introduction to them.

[ Parent | on HN ]

Re:Don't use Hadoop when your data isn't that big by acidity on Wednesday September 18, 2013 @12:20AM (#6403460)

Okay. I already have read about the algorithms and even implemented them crudely while studying them.

Just not a big fan of NHI. But if in this case, thats the best way - let it be :)

[ Parent | on HN ]