News for hackers. Stuff that matters.
Re:Introduction to Apache Airflow by ForHackernews on Friday May 29, 2020 @06:15PM (#23356180)
Using the KubernetesPodOperator for everything adds a huge amount of overhead. You still need Airflow worker nodes, but they're just babysitting the K8S pods doing the real work.

I know it's 2020 and memory is cheap or whatever, but Airflow is shockingly wasteful of system resources.

There are no comments on this comment yet.