News for hackers. Stuff that matters.
Re:Effective Airflow Development by theboat on Tuesday August 18, 2020 @11:32PM (#24206880)
I would make use of ETL-as-a-service vendors as much as possible (Stitch, fivetran, etc.) before going to airflow/prefect for the more custom stuff.

Airflow 2.0 will have some pretty nice features for ML development as well.

Re:Effective Airflow Development by FridgeSeal on Tuesday August 18, 2020 @11:41PM (#24206925)
I'm so very hesitant of workflows-as-a-service: they just seems like a fantastic way to get really locked-in to some incredibly specific vendor; add in the fact that if you're required to maintain geographical-jurisdiction of your data, or you have constraints about 3rd-parties having access to your data then you're more-or-less out of luck.

Also they all seem to charge so very much for what amounts to a fairly straightforward service...