News for hackers. Stuff that matters.
Re:What Is Dbt and Why Are Companies Using It? by antruok on Friday December 03, 2021 @02:10AM (#29427441)
The snapshots feature should handle the slowly changing dimensions. But are you saying it's not flexible enough for certain edge cases?
Re:What Is Dbt and Why Are Companies Using It? by andygrd on Friday December 03, 2021 @03:19AM (#29427800)
Yeah, dbt snapshots do a row hash and update if anything in the row changes. We had a source table that had a bunch of daily changing timestamps, e.g. "load date", that we needed to ignore, and focus on a business key. Dbt was an utter torment to try get this going. Ended up building a more elegant framework without it.
Re:What Is Dbt and Why Are Companies Using It? by antruok on Friday December 03, 2021 @05:01AM (#29428347)
So apparently the check_cols parameter didn't help either?

I'm trying to learn about the critical pain points of dbt, and this case seems interesting.