News for hackers. Stuff that matters.
Re:Learn R two minutes at a time by alook on Saturday May 26, 2012 @07:36PM (#4028717)
Regarding R for BigData, do you think R is going to continue to be a stable of the analytical toolset as data sizes continues to grow?

I use R to prototype machine learning techniques on a small set of data, or visualize some summary statistics. But if I want to run K-Means Clustering or Support Vector Machine algorithms on 1,000,000,000 rows of data, I've found that running R on Hadoop is tricky. There are some libraries out there ( for example, RHadoop https://github.com/RevolutionAnalytics/RHadoop/wiki/rmr ) but they require writing your algorithm in such a manner that algorithms must be adapted to run within map() and reduce() functions. My understanding is that the built-in functions that make R so useful will often not adapt well to a mapreduce algorithm.

From what I've seen, once an algorithm is prototyped in something like R/Matlab, if the data size warrants it, it's best to re-write the algorithm in Java MapReduce or use Apache Mahout.

Re:Learn R two minutes at a time by aheilbut on Saturday May 26, 2012 @08:06PM (#4028781)
or C.