News for hackers. Stuff that matters.

A comment on The Unbundling of Airflow. Parent comment

Re:The Unbundling of Airflow by otabdeveloper4 on Wednesday February 16, 2022 @01:49AM (#30357027)
> there are far better tools out there for scheduling

Really? Which ones? The only thing vaguely fitting this case is Jenkins, but using Jenkins to run ETL/ELT is a serious impedance mismatch.

[ Parent | on HN ]
Re:The Unbundling of Airflow by urthor on Wednesday February 16, 2022 @02:21AM (#30357208)
Dagster/Prefect are the alternatives.

But yes, I'm confused. Triggering a dag and having it exit based on complex logic is a perfectly normal pattern.

[ Parent | on HN ]