News for hackers. Stuff that matters.
Re:Launch HN: BuildFlow (YC W23) – The FastAPI of data pipel... by 0xDEF on Wednesday March 15, 2023 @03:26PM (#35173464)
How does this compare with Airflow and Dagster?
Re:Launch HN: BuildFlow (YC W23) – The FastAPI of data pipel... by calebtv on Wednesday March 15, 2023 @03:55PM (#35173844)
Good question, I would say we're more focused on being a data pipeline engine as opposed to workflow orchestration. So you could use something like Airflow or Dagster to trigger your BuildFlow pipeline.
Re:Launch HN: BuildFlow (YC W23) – The FastAPI of data pipel... by Kalanos on Wednesday March 15, 2023 @04:50PM (#35174530)
by not addressing them and prefect in your initial post, it's a bit hit to credibility
Re:Launch HN: BuildFlow (YC W23) – The FastAPI of data pipel... by TankeJosh on Wednesday March 15, 2023 @05:05PM (#35174710)
We chose not to reference them because we are mainly focused on streaming use cases, which don't fit well in the prefect & dagster models.
Re:Launch HN: BuildFlow (YC W23) – The FastAPI of data pipel... by Kalanos on Thursday March 16, 2023 @03:43PM (#35187286)
nice. that's an easy statement to make about competitive advantage since airflow explicitly states (or did state) that they are not for streaming