News for hackers. Stuff that matters.

A comment on Lessons learned from running Apache Airflow at scale. Parent comment

Re:Lessons learned from running Apache Airflow at scale by nooorofe on Monday May 23, 2022 @07:59PM (#31486359)
very basic use cases:

* run job for given reporting_period * backfill data for reporting_period between N and M * lookup failed jobs

Nothing in Databricks supports that.

[ Parent | on HN ]
Re:Lessons learned from running Apache Airflow at scale by maslam on Tuesday May 24, 2022 @02:07AM (#31488553)
Databricks PM here.

Backfills are on our roadmap We are previewing looking up failed jobs soon.

Email me at bilal dot aslam at Databricks dot com if you want more info

[ Parent | on HN ]