News for hackers. Stuff that matters.
Re:Lessons learned from running Apache Airflow at scale by TYPE_FASTER on Monday May 23, 2022 @12:37PM (#31481276)
AWS offers a service for managed Airflow: https://aws.amazon.com/managed-workflows-for-apache-airflow/

Makes me wonder if Amazon internally was using Step Functions, ran into issues trying to scale to larger graphs, realized multiple teams were using Airflow, and created the Managed Airflow service.

There are no comments on this comment yet.