News for hackers. Stuff that matters.
Re:DVC – Open Source Machine Learning Version Control System by tolstoyevsky on Wednesday February 13, 2019 @11:33AM (#19154270)
I think maybe this could better illustrate what can be done using DVC: https://dagshub.com/DAGsHub-Official/DAGsHub-Tutorial-MNIST

You can navigate branches, and be able to download the data, model, and intermediate pipeline files from a shared team AWS,GS,Hadoop, or plain NFS or SSH server, as they were in a specific commit. Also compare metrics between branches for comparison of different experiments, etc. A team member can checkout a branch, immediately get the relevant files which were already computed by someone else, modify the training code, reproduce the out-of-date parts of the pipeline using dvc repro, and then git commit the resulting metrics + dvc push the resulting model back to the shared team storage.

There are no comments on this comment yet.