News for hackers. Stuff that matters.

A comment on In search of a better job scheduler.

Re:In search of a better job scheduler by dswalter on Saturday January 18, 2020 @07:16PM (#22088410)
Is there a reason not to consider apache airflow? https://airflow.apache.org/

You could run it on a digital ocean droplet so you don't have to worry about your laptop turning off. It covers retry and cron-style job kickoffs.

[ Parent | on HN ]
Re:In search of a better job scheduler by demosito666 on Sunday January 19, 2020 @01:35AM (#22089832)
Complexity, effectively not supporting shorter scheduling interval (if you need to run something more frequently than every 20 minutes, beware), some bugs don't get fixed for years and are very hard to debug. We ended up restating the scheduler on regular Cron to kick stale task queue.
[ Parent | on HN ]