Re:Airflow and the Future of Data Engineering: A Q&A
by throwaway_374 on Wednesday March 01, 2017 @04:39AM
(#13762522)
Minor gripe - why can I not execute an entire DAG (end to end) from the UI? Also trying to execute single tasks from the UI using the "run" functionality gives a CeleryExecutor requirement error... sorry, I know this isn't the help forums but it sounds like the most trivial tasks were overlooked.
[ Parent
| on HN ]
Re:Airflow and the Future of Data Engineering: A Q&A
by detroitcoder on Wednesday March 01, 2017 @10:37AM
(#13764482)
Actually you can but it is a bit clunky. Go to Browse > Dag Runs and select the 'Create' tab. This pulls up a form where you type in the Dag ID, enter the start time (set to now but keep in mind it is the local time of the web server), and a Run ID.
Totally agree there should be both a simple Start Run and Stop Run button.
Re:Airflow and the Future of Data Engineering: A Q&A
by tedmiston on Wednesday March 01, 2017 @11:06AM
(#13764813)
What I've been doing when debugging is flipping the DAG switch to off, clearing the first task in the DAG so the whole thing re-runs, then back to on.
Re:Airflow and the Future of Data Engineering: A Q&A
by frugalmail on Wednesday March 01, 2017 @01:57PM
(#13766978)
Azkaban has this.