Ask HN: What is your ML stack like?

Re:Ask HN: What is your ML stack like? by aaron-santos on Tuesday November 12, 2019 @05:47PM (#21519064)

> The tradeoff has been theres a step between notebook and production for ML engineers which can slow them down, but it forces code review and increases the number of tests checked in.

This was a game-changer for us. What does your testing story look like?

[ Parent | on HN ]

Re:Ask HN: What is your ML stack like? by __erik on Tuesday November 12, 2019 @08:26PM (#21520278)

We're still ironing out a few things but unit tests for various functions then we have smol statistically representative datasets for each model. In CI we train a model on the small dataset (aim for <5 mins e2e) then have a a suite of model metrics we care about, tests confirm values are within acceptable bounds and the test values are pulled into the PR.

[ Parent | on HN ]