News for hackers. Stuff that matters.

A comment on The new local data stack: Integrating Dagster, dbt and DuckDB. Parent comment

Re:The new local data stack: Integrating Dagster, dbt and Du... by geoHeil on Thursday December 14, 2023 @12:33PM (#38644203)
Well local can mean your laptop. But could mean your local server. However, it can also mean a VM on your cloud provider of choice colocated to the object store.

In such a case the network transfer (for many cases) can be almost irrelevant - at least for up to medium-ish sized datasets.

[ Parent | on HN ]
Re:The new local data stack: Integrating Dagster, dbt and Du... by Jgrubb on Friday December 15, 2023 @01:54PM (#38657277)
Funny thing, I'm trying to get going with Dagster today like I said, and figuring out how to debug is a bit .. annoying. The most helpful post I've come across so far just happens to be https://georgheiler.com/2022/02/02/interactive-dagster-debug...

So thanks!

[ Parent | on HN ]