flowair
Re:Lessons learned from running Apache Airflow at scale
on Wednesday May 25, 2022 @10:34AM (#31505143)
download the astronomer CLI and it will spin up a local dockerized instance of airflow in about 1 minute tops
https://docs.astronomer.io/astro/install-cli
Re:Lessons learned from running Apache Airflow at scale
on Wednesday May 25, 2022 @10:18AM (#31504870)
How about the dynamic task mapping that is now available in 2.3?
Re:Lessons learned from running Apache Airflow at scale
on Monday May 23, 2022 @04:23PM (#31484372)
@task.python(task_id="this_is_my_task_name")
def my_func():
...