News for hackers. Stuff that matters.
Re:Lessons learned from running Apache Airflow at scale by hatware on Monday May 23, 2022 @12:48PM (#31481445)
It definitely takes some time getting used to the quirks of Airflow. I know it took 6 months of running it at my last gig to really understand what was happening underneath the UI.

With great control comes great responsibility.

Re:Lessons learned from running Apache Airflow at scale by dekhn on Monday May 23, 2022 @12:51PM (#31481483)
actually I concluded it was just not that great a workflow engine. It's probably just intended for a different use case than mine.