News for hackers. Stuff that matters.

A comment on Lessons learned from running Apache Airflow at scale. Parent comment

Re:Lessons learned from running Apache Airflow at scale by flowair on Monday May 23, 2022 @04:23PM (#31484372)
@task.python(task_id="this_is_my_task_name")

def my_func():

...

[ Parent | on HN ]
Re:Lessons learned from running Apache Airflow at scale by mywittyname on Monday May 23, 2022 @05:33PM (#31485033)
This still has the problem that, when you call my_func multiple times in the same dag, the resulting tasks will be labelled, my_func, my_func__1, my_func__2, ...
[ Parent | on HN ]
Re:Lessons learned from running Apache Airflow at scale by flowair on Wednesday May 25, 2022 @10:18AM (#31504870)
How about the dynamic task mapping that is now available in 2.3?
[ Parent | on HN ]