News for hackers. Stuff that matters.
Re:Launch HN: BuildFlow (YC W23) – The FastAPI of data pipel... by calebtv on Wednesday March 15, 2023 @12:21PM (#35170656)
Thanks! Currently you can't, right now your only option is to use our ray runner. But we have talked about supporting different runner options similar to how Beam can be run on Spark, Dataflow, etc. And ultimately it would be nice if folks could implement their own runners, but I think we're still a ways out on that.
Re:Launch HN: BuildFlow (YC W23) – The FastAPI of data pipel... by calebtv on Wednesday March 15, 2023 @04:28PM (#35174273)
I should also mention BuildFlow does support stateful processing with the Processor class API: https://www.buildflow.dev/docs/processors/overview#processor...