News for hackers. Stuff that matters.

yepitsthat

Re:Binance built a 100PB log service with Quickwit on Friday July 12, 2024 @02:56AM (#40943264)
Both solved by having a sidecar (think of as a local ingestion point) that records everything (no waiting for flush on error), and then does tail sampling on the spans where status is non OK - i.e. everything thats non OK gets sent to Datadog, Baselime, your Grafana setup, your custom Clickhouse 100PB storage nodes. Or take your pick of any of 1000+ OpenTelemetry compatible providers. https://opentelemetry.io/docs/concepts/sampling/#tail-sampli...

Pattern is the ~same.

Re:Binance built a 100PB log service with Quickwit on Friday July 12, 2024 @02:54AM (#40943256)
You're nearly there. Tail sampling on non OK states.

https://opentelemetry.io/docs/concepts/sampling/#tail-sampli...