Re:I built Vector. Now I'm answering the question your obser...
by whazor on Wednesday January 14, 2026 @01:15PM
(#46619934)
We store the data because we might need to know it. We only discover we didn’t need to know it once we’ve finished knowing it.
[ Parent
| on HN ]
Re:I built Vector. Now I'm answering the question your obser...
by binarylogic on Wednesday January 14, 2026 @02:04PM
(#46620957)
Agree to an extent. There are absolutely unknown unknowns. But I think you'd be surprised how much data is obviously waste. Not the grey area, just pure garbage: health checks, debug logs left in production, redundant attributes.
That's why we break waste down into categories: https://docs.usetero.com/data-quality/categories/overview
But we don't stop there. You can go deeper with reasoning to root out the more nuanced waste. It's hard, but it's possible. That's where things get interesting.