News for hackers. Stuff that matters.
Re:Netflix's Metaflow: Reproducible machine learning pipelines by nextaccountic on Monday December 21, 2020 @11:40PM (#25502921)
Hi! How do you handle floating point determinism? Can some ML be reproduced in any architecture? Can you build the code with another compiler version? Can you use newer SIMD instructions?

Or you're forever tied to the initial hardware+compiler version?

Re:Netflix's Metaflow: Reproducible machine learning pipelines by vtuulos on Tuesday December 22, 2020 @12:06AM (#25503081)
Reproducibility is a spectrum. A good starting point is to snapshot the exact version of the code that produced a model. Even better, you should snapshot the full dependency graph, including transitive dependencies, of all (compiled) libraries, which Metaflow does with @conda. Together with data snapshots, this gives a pretty good foundation for reproducibility.

Depending on the libraries you use, the exact results may or may not be reproducible on other architectures. If cross-platform reproducibility is important to you, you should choose your libraries accordingly. Metaflow provides the tools for choosing the level of reproducibility that your application requires.

Re:Netflix's Metaflow: Reproducible machine learning pipelines by nextaccountic on Tuesday December 22, 2020 @11:38PM (#25514448)
Is there any library in the metaflow ecosystem that offers floating point determinism? I would like to read more, can you link somewhere?

Also, what tools does metaflow offers to control the level of reproducibility?