Re:ETL Pipelines with Airflow: The Good, the Bad and the Ugly
by rockostrich on Friday October 08, 2021 @12:27PM
(#28801097)
Agreed. I see a lot of folks coming up with one off solutions for pulling data out of 3rd party sources like Kustomer or Lever. Giving a centralized UI for setting that up would be a great service.
Seems like I have a fun weekend project.
I still think that Airflow is great for power data engineers. Airbyte and dbt are positioned to empower data analysts (or lazy data engineers like me) to own the ELTs.