News for hackers. Stuff that matters.
Re:Data science tips and tricks from the developer community by NumberCruncher on Tuesday September 05, 2017 @11:43AM (#15176313)
In my experience if you develop a "data science pipeline" forcing the data scientist to build

- reproducible

- validated

- back-tested

- easy to deploy

models, they are going to hate it. It just kills the fun and/or makes obvious if they made a mistake.

Re:Data science tips and tricks from the developer community by gipp on Tuesday September 05, 2017 @12:56PM (#15176988)
So we should sacrifice all the things that actually make a Data Scientist's work valuable in the name of fun and obscuring mistakes?

Fun I almost get, obviously good for productivity (though I think you'd really be sacrificing productive output for non-productive output), but I just don't get where you're even coming from with the "making mistakes more obvious" angle.

Re:Data science tips and tricks from the developer community by carlmr on Tuesday September 05, 2017 @03:59PM (#15178604)
I think he was being facetious. Of course we need all these things, but data science right now is still not that mature I guess.
Re:Data science tips and tricks from the developer community by CJefferson on Tuesday September 05, 2017 @11:47AM (#15176360)
I blame software.

I don't understand why we couldn't have some system, perhaps using strace and friends, which tracks everything I ever do, and how every file was created. Then I could just say "how did I make X?"

Re:Data science tips and tricks from the developer community by carlmr on Tuesday September 05, 2017 @03:57PM (#15178592)
Make it happen!