Meltano: ELT for the DataOps era

Re:Meltano: ELT for the DataOps era by brylie on Monday March 01, 2021 @03:11AM (#26300612)

Looks like it will integrate with Airflow and dbt. I like to see this kind of synergy in the open-source community.

[ Parent | on HN ]

Re:Meltano: ELT for the DataOps era by tayloramurphy on Monday March 01, 2021 @07:14AM (#26302007)

You're correct, it currently does integrate with Airflow and dbt. I'm a big fan of both having used them basically every day for the past 3 years. The dbt community has done wonders for me personally and professionally and we're hoping to help build upon the dbt community (and others) to include open source data integration.

[ Parent | on HN ]

Re:Meltano: ELT for the DataOps era by pchal on Monday March 01, 2021 @08:18AM (#26302468)

Any plans to integrate with dagster for pipeline orchestration (instead of airflow)?

[ Parent | on HN ]

Re:Meltano: ELT for the DataOps era by tayloramurphy on Monday March 01, 2021 @08:31AM (#26302578)

Yep! We have this issue[0] open. I'm also interested in getting Prefect and GitLab CI as orchestrators too.

[0] https://gitlab.com/meltano/meltano/-/issues/2393

[ Parent | on HN ]