News for hackers. Stuff that matters.

A comment on Show HN: Kestra - Open-Source Airflow Alternative.

Re:Show HN: Kestra - Open-Source Airflow Alternative by speedgoose on Thursday March 24, 2022 @01:11PM (#30792681)
Can you run software containers as steps ?
[ Parent | on HN ]
Re:Show HN: Kestra - Open-Source Airflow Alternative by tchiotludo on Thursday March 24, 2022 @01:20PM (#30792803)
Yes, of course!

You have 3 solutions for that:

- you can use this task using runner:DOCKER property and choose the image: https://kestra.io/plugins/core/tasks/scripts/io.kestra.core....

- you can also use PodCreate to launch a pod on a kubernetes cluster: https://kestra.io/plugins/plugin-kubernetes/tasks/io.kestra....

- you have also CustomJob from VertexAI on GCP to be able to launch a container a ephemeral cluster (with any CPU / GPU): https://kestra.io/plugins/plugin-gcp/tasks/vertexai/io.kestr...

[ Parent | on HN ]
Re:Show HN: Kestra - Open-Source Airflow Alternative by speedgoose on Friday March 25, 2022 @01:45AM (#30799023)
Great! That makes Kestra more useful than Dagster for me.
[ Parent | on HN ]