Re:R Is Not Enough For "Big Data"...
by canopylabs on Friday May 04, 2012 @03:21PM
(#3929908)
Sorry to say, but I disagree with the premise of this article. You still need R to answer many of the questions the author of the article is proposing to answer.
On top of that, having a degree in AI will prepare you for a lot of real-world problems because you've been lots of data sets. I'd prefer to have an PhD-level researcher who knows why my support vector machine is overtrained, than a guy with real-world experience who is likely to overtrain and bias the model.
Furthermore, the author's example of weight and height correlation isn't one of a bad model. It would be a perfectly fine model if that was all the data you had. If you ignore lots of input data to build a crappy model, you're going to have a bad time... But everyone with a PhD and now "real world experience" would know this.
On top of that, having a degree in AI will prepare you for a lot of real-world problems because you've been lots of data sets. I'd prefer to have an PhD-level researcher who knows why my support vector machine is overtrained, than a guy with real-world experience who is likely to overtrain and bias the model.
Furthermore, the author's example of weight and height correlation isn't one of a bad model. It would be a perfectly fine model if that was all the data you had. If you ignore lots of input data to build a crappy model, you're going to have a bad time... But everyone with a PhD and now "real world experience" would know this.