Launch HN: UpTrain (YC W23) – Open-source performance monitoring for ML models

Re:Launch HN: UpTrain (YC W23) – Open-source performance mon... by vvipgupta on Wednesday March 08, 2023 @11:49AM (#35071344)

Additionally, refinement is a key focus of ours. Figuring out the best data points to retrain the model upon has twin benefits:

1) It provides automated issue resolution and saves data scientists' effort to debug and fix their models. 2) It allows us to reduce false positives in alerting: we send alerts only when we see a dip in model performance, or retraining can lead to improved model accuracy.

[ Parent | on HN ]

Re:Launch HN: UpTrain (YC W23) – Open-source performance mon... by elijahbenizzy on Wednesday March 08, 2023 @12:09PM (#35071662)

Awesome! Big fan of OS -- arize is powerful yet expensive, so I think there's a big market there. Alerting is super tough to get right, and false positives are often worse than no alerting at all. In ML its even harder cause "data looks weird" is like 90% of the bugs.

Anyway, congrats! Excited to see where you go with this.

[ Parent | on HN ]

Re:Launch HN: UpTrain (YC W23) – Open-source performance mon... by vvipgupta on Wednesday March 08, 2023 @04:02PM (#35074664)

Thanks! Also, wondering how did you hear about Arize? Have you dealt with the pain of ML model monitoring in the past?

[ Parent | on HN ]

Re:Launch HN: UpTrain (YC W23) – Open-source performance mon... by elijahbenizzy on Thursday March 09, 2023 @03:07PM (#35085946)

Yeah, so we used it and built some custom solutions at Stitch Fix. Reach out to my co-founder Stefan (also in YC '23) -- he'll have some insight for you.

[ Parent | on HN ]

Re:Launch HN: UpTrain (YC W23) – Open-source performance mon... by sourabh03agr on Friday March 10, 2023 @07:16PM (#35103308)

Thanks! Reaching out to Stefan

[ Parent | on HN ]