News for hackers. Stuff that matters.

A comment on New Apache Airflow Operators for Google Generative AI. Parent comment

Re:New Apache Airflow Operators for Google Generative AI by annexrichmond on Monday August 12, 2024 @02:36PM (#41227829)
I've done a lot evaluation of such frameworks, and I hope to publish more on it. It really depends on your requirements. I would look at Prefect, Flyte, Dagster, and Temporal ahead of Airflow, though.
[ Parent | on HN ]
Re:New Apache Airflow Operators for Google Generative AI by 0cf8612b2e1e on Monday August 12, 2024 @02:59PM (#41228070)
Airflow is kind of the default platform. If you do not have a goto alternative which is superior in multiple dimensions today, I think that says the problem itself is hard.

Might as well go with the devil everyone knows.

[ Parent | on HN ]
Re:New Apache Airflow Operators for Google Generative AI by 8organicbits on Monday August 12, 2024 @03:19PM (#41228261)
Where do you think you'd publish it? I'm interested to read the details.
[ Parent | on HN ]
Re:New Apache Airflow Operators for Google Generative AI by whalesalad on Monday August 12, 2024 @02:59PM (#41228065)
We've been running Dagster for ~6 months on ECS and it has been rock solid. (knocks on wood)
[ Parent | on HN ]