News for hackers. Stuff that matters.
Re:Introduction to Apache Airflow by simo7 on Friday May 29, 2020 @11:47AM (#23351379)
> You can totally design your tasks to be idempotent

Yes of course, I mean Airflow is not a good fit for the tasks you don't want to be idempotent (I think most but not all tasks should be idempotent).

> I've never ran into issues with cross dag dependencies

I believe Airflow docs advice against them when possible. I see why from my experience: less visibility and more complexity, especially for backfills.

There are no comments on this comment yet.