Re:What Is Dbt and Why Are Companies Using It?
by antruok on Friday December 03, 2021 @02:10AM
(#29427441)
The snapshots feature should handle the slowly changing dimensions. But are you saying it's not flexible enough for certain edge cases?
[ Parent
| on HN ]
Re:What Is Dbt and Why Are Companies Using It?
by andygrd on Friday December 03, 2021 @03:19AM
(#29427800)
Yeah, dbt snapshots do a row hash and update if anything in the row changes. We had a source table that had a bunch of daily changing timestamps, e.g. "load date", that we needed to ignore, and focus on a business key. Dbt was an utter torment to try get this going. Ended up building a more elegant framework without it.