News for hackers. Stuff that matters.

A comment on Metaflow, Netflix's Python framework for data science, is now open source. Parent comment

Re:Metaflow, Netflix's Python framework for data science, is... by bhtucker on Tuesday December 03, 2019 @06:08PM (#21697868)
The centralized DAG scheduler seems like a pretty important part. How much will not having Meson hamper the usability?
[ Parent | on HN ]
Re:Metaflow, Netflix's Python framework for data science, is... by pela on Tuesday December 03, 2019 @06:10PM (#21697888)
Hi bhtucker, We do have plans to integrate with production-grade schedulers in the very near future. https://github.com/Netflix/metaflow/issues/2
[ Parent | on HN ]
Re:Metaflow, Netflix's Python framework for data science, is... by vtuulos on Tuesday December 03, 2019 @07:02PM (#21698274)
note that Metaflow comes with a built-in DAG scheduler, so it is perfectly usable without a centralized scheduler like Meson.

Integrations to Airflow or StepFunctions are on the roadmap, depending on what seems to resonate with people outside Netflix.

[ Parent | on HN ]