karog

Re:Airflow's Problem on Tuesday August 02, 2022 @12:36PM (#32320933)

There's also Flyte, which is natively data aware and schedules tasks around data dependencies. The syntax is essentially pure python too.

Union.ai launches to accelerate machine learning orchestration using Flyte

Posted by karog on Tuesday April 12, 2022 @07:21PM
from the techcrunch.com dept.

( Read More... | no comments | 10 points | on HN )

Re:Orchestrating Data Pipelines at Lyft: Comparing Flyte and Airflow on Thursday March 24, 2022 @07:57PM (#30797103)

Great comparison between Flyte and Airflow! Is there a way to incrementally adopt Flyte and use Flyte downstream from an Airflow dag?

Posted by karog on Wednesday November 18, 2020 @02:54PM
from the eng.lyft.com dept.

( Read More... | no comments | 4 points | on HN )