Re:The new local data stack: Integrating Dagster, dbt and Du...
by geoHeil on Thursday December 14, 2023 @12:37PM
(#38644264)
Hi,
Georg - one of the authors is here.
What we argue is that:
- for a great software/data engineering/creation experience we recommend such a stack that is only on when needed (when transformations occur)
- for a great data consumption experience we suggest the integration with an established PaaS platform. Not only for the sake of being available (as a serving layer of data to end users) but also for the missing fine-grained RBAC in the proposed transformation layer
Georg - one of the authors is here.
What we argue is that:
- for a great software/data engineering/creation experience we recommend such a stack that is only on when needed (when transformations occur)
- for a great data consumption experience we suggest the integration with an established PaaS platform. Not only for the sake of being available (as a serving layer of data to end users) but also for the missing fine-grained RBAC in the proposed transformation layer