Re:The Data Science loop: the day-to-day work of a data scie...
by dude_abides on Tuesday September 25, 2012 @02:31PM
(#4571883)
That's a good idea; I will try and write up such a "low level" post this week. As a preview, the things that will prominently feature in the post are - RStudio, custom functions/aggregates in Postgres PL/R, and Sweave. (yes I am a R fanboy).
[ Parent
| on HN ]
Re:The Data Science loop: the day-to-day work of a data scie...
by pav3l on Tuesday September 25, 2012 @02:56PM
(#4572021)
Would definitely like to read it!
I personally find the need to go back and forth quite a bit between different tools when working even on a single dataset. Say, i'll do some work with text part of the dataset in Python, then use Matlab for some basic quantitative analysis, then use R for some advanced statistics if I have to, port those results back to Matlab/Python for speed, then back to R to sweave, maybe some spreadsheet stuff too, etc... So for me, for every project I need to have my dataset in easily accessible format (csv/someSQL/etc) and I need scripts in every language that I use, that would communicate with the data source and get "up to speed" right away.
It's little tips like that I think people should be sharing more.