Re:Netflix's Metaflow: Reproducible machine learning pipelines
by smurf_t on Monday December 21, 2020 @01:45PM
(#25497986)
What are the main advantages compared to Airflow. We use Airflow to orchestrate ML jobs/tasks, and I found it to be more flexible comparing other tools we tested.
[ Parent
| on HN ]
Re:Netflix's Metaflow: Reproducible machine learning pipelines
by vtuulos on Monday December 21, 2020 @01:55PM
(#25498085)
Metaflow is largely complementary to a job scheduler like Airflow. Technically you could export Metaflow workflows to Airflow, although the specific integration doesn't exist yet. For more details, see this blog article https://netflixtechblog.com/unbundling-data-science-workflow...