Re:Data Distribution Shifts and Monitoring
by mrbuzzinfrog on Wednesday February 16, 2022 @04:08PM
(#30365698)
A very important topic. Specially if you are into MLOps!
If your product is mainly powered by AI, and you found "AI-product-fit", then this topic should be something you bring up to the AI team tomorrow or to the infra team.
AI models are powerful yet sensitive, and how new samples (out-of-dist) could affect them is hard to anticipate.
The other day I came across https://www.raymon.ai/, "Observability for AI systems
". I'vent tried Raymon yet, but looks promising.
If your product is mainly powered by AI, and you found "AI-product-fit", then this topic should be something you bring up to the AI team tomorrow or to the infra team.
AI models are powerful yet sensitive, and how new samples (out-of-dist) could affect them is hard to anticipate.
The other day I came across https://www.raymon.ai/, "Observability for AI systems ". I'vent tried Raymon yet, but looks promising.