News for hackers. Stuff that matters.

EvgenyAr

Re:Ask HN: What do you use to run ML/DL in prod? on Monday December 27, 2021 @08:54AM (#29702525)
Sound awesome! Looks like you invested a lot, e.g. inference batch is not easy at all. Few follow up questions: - Do you really retrieve embedding on every batch? Doesn't it make sense to keep them in memory (must not be more than few gigs)? - Do you have/plan to incorporate inference feedback loop for retraining? Or you call it metric as well?

Thanks for an answer!

Ask HN: What do you use to run ML/DL in prod?

I know there are several options to serve your ML models in production? Now I'm going through MLOps course from Andrew Ng (https://www.coursera.org/specializations/machine-learning-engineering-for-production-mlops) Theoretical part is wonderful, however part about Tensoflow (TFX, Transform) is really a pain.So question: - Which stack do you use to serve ML in prod properly - with CI/CD,...

( Read More... | 3 comments | 2 points | on HN )