Re:The Hidden Cost of Using Laptops for Data Science
by dwhitena on Tuesday May 09, 2017 @09:51PM
(#14305360)
Reproducibility and provenance are essential for the data science workflows. And it's important to maintain these at scale. Take a look at Pachyderm some time as well if you get a chance (I work on the project for full disclosure). We version data in addition to code for full reproducibility. Even for distributed multi-stage and multi-language pipelines.
[ Parent
| on HN ]
There are no comments on this comment yet.