News for hackers. Stuff that matters.
Re:What Is Dbt and Why Are Companies Using It? by glogla on Friday December 03, 2021 @12:37PM (#29432699)
Singer and dbt are different - dbt orchestrates stuff (evaluates macros and runs SQLs) while Singer actually has the data flow through it. So rewriting Singer in something fast (I guess Java since even the most obscure database has JDBC driver for it) would definitely help.

It would only help once you start shuttling around terabytes.

Re:What Is Dbt and Why Are Companies Using It? by tomnipotent on Friday December 03, 2021 @05:29PM (#29436424)
These tools were not built for multi-tb workloads, and pointing out that as a deficiency when it was clearly not a design goal is a misleading argument.