News for hackers. Stuff that matters.
Re:The Rise of the Data Scientist by acgourley on Tuesday July 07, 2009 @03:35PM (#692260)
As for your latter suggestion - I think its unrealistic to build a general web-based solution. As you are describing it, you would essentially be hosting R, some visualization tool, and a scripting tool. That's absurd enough and doesn't even address the bandwidth issue - these datasets are usually huge.

You'd be better off writing enterprise software in this field. Especially considering anyone who would pay for data munging and visualization tools/services probably doesn't want their data out on the internet.

Re:The Rise of the Data Scientist by neilc on Wednesday July 08, 2009 @12:17AM (#693237)
I think its unrealistic to build a general web-based solution

Maybe not a perfectly "general" solution, but there are lots of domains where data is analyzed that would benefit from a powerful web-based analytic environment.

these datasets are usually huge

Not all interesting datasets are huge. Some large data sets can easily be shared among users -- Amazon already hosts a lot of common data sets in EC2 already, for example. Given the steadily-decreasing cost of bandwidth and the fact that you don't need interactive response (at least for the initial data load), I don't think it's that impractical for a pretty wide set of scenarios.

Re:The Rise of the Data Scientist by jimbokun on Wednesday July 08, 2009 @10:59AM (#693996)
"As for your latter suggestion - I think its unrealistic to build a general web-based solution."

Might be a dual product strategy, the public facing webapp with limits on data size to test drive, and customer site installed enterprise version. Or maybe some solution that uses Amazon storage (in other words, outsource data storage and security issues to Amazon).

Of course, Google had the two tier search idea (they wanted to monetize by selling custom search servers to businesses) but found the real money was to be made on the consumer facing side. So you never know.

Re:The Rise of the Data Scientist by paulsb on Thursday July 09, 2009 @05:37AM (#695526)
I think there is a need and place for it.

One of the things I am hoping to do with my start-up is to build simple tools to help wet-lab scientists access informatics solutions to analyse and visualise their data, and simple tools for informatics scientists to visualise their data so that a wet-lab scientist can understand it (more easily). There is a huge communication gap between (bio)wet-lab and (bio)informaticians, and I think 'data science' tools can help to bridge that gap.

Re:The Rise of the Data Scientist by vbar on Wednesday July 08, 2009 @01:22AM (#693335)
Hosting R is already implemented - see http://predict.i2pi.com/
Re:The Rise of the Data Scientist by jimbokun on Wednesday July 08, 2009 @10:56AM (#693987)
Yes, this looks a lot like what I had in mind. Reading his blog entry, I like that he is getting something out there, even though it is not all of what he originally had in mind. If he keeps iterating, he should do well. I wonder if he has any thoughts on business models.