Re:Introducing dbt + Materialize
by andrenotgiant on Monday March 01, 2021 @02:18PM
(#26306937)
Relevant related post: A data pipeline is just a materialized view: https://nchammas.com/writing/data-pipeline-materialized-view
[ Parent
| on HN ]
Re:Introducing dbt + Materialize
by jldlaughlin on Monday March 01, 2021 @03:24PM
(#26307900)
Neat! We're totally on the same page--incremental view maintenance not only makes materialized views a useful building block for data pipelines, it can make them much simpler, too!
So it is CTEs all the way down, a bag of dags. A raw table is just a view over the raw data, a cooked view is just a view of views, repeat.
Do you use any of the ideas of Noria? Cadence?
This is great, but at what COST?!