News for hackers. Stuff that matters.
Re:Koheesio: Nike's Python-based framework to build advanced... by alessmar on Tuesday June 04, 2024 @08:33AM (#40573838)
A few weeks ago, I chose to write my data pipelines using Apache Beam. It seems that Koheesio shares some features with this project, but I believe Apache Beam is superior due to its ability to run on various runners, support multiple programming languages, and integrate with numerous data sources and destinations.
Re:Koheesio: Nike's Python-based framework to build advanced... by esafak on Tuesday June 04, 2024 @01:35PM (#40577000)
If I wanted an abstraction layer for writing pipelines today I'd look into ZenML: https://www.zenml.io/vs/zenml-vs-orchestrators