News for hackers. Stuff that matters.
Re:Show HN: I built an open-source data pipeline tool in Go by producthunter90 on Tuesday December 17, 2024 @12:07PM (#42443067)
How does it handle scheduling or orchestrating pipeline runs? Do you integrate with tools like Airflow, or is there a built-in solution for that?
Re:Show HN: I built an open-source data pipeline tool in Go by karakanb on Tuesday December 17, 2024 @12:22PM (#42443189)
Bruin orchestrates individual runs for single pipelines, which means you can use any tool to schedule the runs outside and the assets will be orchestrated by Bruin. You can use GitHub Actions, Airflow, a regular cronjob, or any other form of scheduling for that.