News for hackers. Stuff that matters.
Re:I built Vector. Now I'm answering the question your obser... by binarylogic on Wednesday January 14, 2026 @01:39PM (#46620478)
You're right, it's not always binary. That's why we broke it down into categories:

https://docs.usetero.com/data-quality/logs/malformed-data

You'd be shocked how much obviously-safe waste (redundant attributes, health checks, debug logs left in production) accounts for before you even get to the nuanced stuff.

But think about this: if you had a service that was too expensive and you wanted to optimize the data, who would you ask? Probably the engineer who wrote the code, added the instrumentation, or whoever understands the service best. There's reasoning going on in their mind: failure scenarios, critical observability points, where the service sits in the dependency graph, what actually helps debug a 3am incident.

That reasoning can be captured. That's what I'm most excited about with Tero. Waste is just the most fundamental way to prove it. Each time someone tells us what's waste or not, the understanding gets stronger. Over time, Tero uses that same understanding to help engineers root cause, understand their systems, and more.

Re:I built Vector. Now I'm answering the question your obser... by nextaccountic on Wednesday January 14, 2026 @02:49PM (#46621858)
I would like to just have a storage engine that can be very aggressive at deduplicating stuff. If some data is redundant, why am I storing it twice?
Re:I built Vector. Now I'm answering the question your obser... by HumanOstrich on Wednesday January 14, 2026 @03:34PM (#46622790)
That's already pretty common, but the goal isn't storing less data for its own sake.
Re:I built Vector. Now I'm answering the question your obser... by nextaccountic on Wednesday January 14, 2026 @08:44PM (#46626828)
> the goal isn't storing less data for its own sake.

Isn't it? I was under impression that the problem is the cost storing all this stuff

Re:I built Vector. Now I'm answering the question your obser... by HumanOstrich on Thursday January 15, 2026 @01:04AM (#46628647)
Nope, you can't just look at cost of storage and try to minimize it. There are a lot of other things that matter.
Re:I built Vector. Now I'm answering the question your obser... by nextaccountic on Thursday January 15, 2026 @02:54AM (#46629439)
What I am asking is, what are the other concerns other than literally the cost? I have interest in this area and I am seeing everyone saying that observability companies are overcharging their consumers.
Re:I built Vector. Now I'm answering the question your obser... by HumanOstrich on Thursday January 15, 2026 @03:21AM (#46629667)
We're currently discussing the cost of _storage_, and you can bet the providers already are deduplicating it. You just don't get those savings - they get increased margins.

I'm not going to quote the article or other threads here to you about why reducing storage just for the sake of cost isn't the answer.

Re:I built Vector. Now I'm answering the question your obser... by nextaccountic on Thursday January 15, 2026 @08:49PM (#46642053)
Well, that's a weirdly confrontational reply. But thanks