Orchestrating Data Pipelines at Lyft: Comparing Flyte and Airflow

Re:Orchestrating Data Pipelines at Lyft: Comparing Flyte and... by karog on Thursday March 24, 2022 @07:57PM (#30797103)

Great comparison between Flyte and Airflow! Is there a way to incrementally adopt Flyte and use Flyte downstream from an Airflow dag?

[ Parent | on HN ]

Re:Orchestrating Data Pipelines at Lyft: Comparing Flyte and... by kumare3 on Thursday March 24, 2022 @08:00PM (#30797130)

Thank you. So at Lyft, there exists an AirflowFlyteOperator. It was designed to interop with Airflow. I know the community is working on open sourcing it. Keep a lookout for the same

[ Parent | on HN ]