News for hackers. Stuff that matters.

A comment on Metaflow, Netflix's Python framework for data science, is now open source. Parent comment

Re:Metaflow, Netflix's Python framework for data science, is... by thundergolfer on Tuesday December 03, 2019 @08:00PM (#21698625)
> For monitoring, we have relied on notebooks this far.

This is pretty interesting approach. Notebooks are a natural environment of Data Scientist and for monitoring they'd provide really good discoverability, flexibility, and interactivity.

Do you use more traditional monitoring that will alert you somehow if a workflow fails, or a workflow hasn't run at all for X hrs/days?

[ Parent | on HN ]
Re:Metaflow, Netflix's Python framework for data science, is... by pela on Tuesday December 03, 2019 @08:12PM (#21698701)
At Netflix, we rely on the workflow scheduler for such alerting and bundle in a layer of triggering mechanism (custom notifications and such)
[ Parent | on HN ]