News for hackers. Stuff that matters.
Re:There is no Data Engineering roadmap by camgunz on Friday July 14, 2023 @05:55AM (#36721746)
We build pipelines in staging schemas, and we only promote them to prod once they pass tests. This is pretty analogous to SWE (it's where we got the idea) and is a pretty crucial part of us meeting the requirement where we don't put inaccurate data in front of customers. It's--of course--only as good as the tests, but that's every reliable system.

There are no comments on this comment yet.