Re:Netflix's Metaflow: Reproducible machine learning pipelines
by vtuulos on Tuesday December 22, 2020 @12:06AM
(#25503081)
Reproducibility is a spectrum. A good starting point is to snapshot the exact version of the code that produced a model. Even better, you should snapshot the full dependency graph, including transitive dependencies, of all (compiled) libraries, which Metaflow does with @conda. Together with data snapshots, this gives a pretty good foundation for reproducibility.
Depending on the libraries you use, the exact results may or may not be reproducible on other architectures. If cross-platform reproducibility is important to you, you should choose your libraries accordingly. Metaflow provides the tools for choosing the level of reproducibility that your application requires.
Re:Netflix's Metaflow: Reproducible machine learning pipelines
by nextaccountic on Tuesday December 22, 2020 @11:38PM
(#25514448)
Is there any library in the metaflow ecosystem that offers floating point determinism? I would like to read more, can you link somewhere?
Also, what tools does metaflow offers to control the level of reproducibility?
Or you're forever tied to the initial hardware+compiler version?