Re:Aim: Record, search and compare ML training runs
by pchal on Thursday January 14, 2021 @08:07AM
(#25775862)
Interesting effort. Does it snapshot the state of source code at the time an experiment is run? Does it do it without requiring a git commit? I believe the Replicate experiment tracking tool does this.
[ Parent
| on HN ]
Re:Aim: Record, search and compare ML training runs
by gevorg_s on Thursday January 14, 2021 @12:15PM
(#25779059)
We have got similar requests couple of times and its in the pipeline. Currently focused on the comparison of 1000s of metrics/training runs. It's a serious challenge both on the Ui and on the storage end.
Inviting you to the Aim [slack channel](https://slack.aimstack.io/). We would love to learn more about such use cases and why they are important.