Re:How we built Uber Engineering's highest query-per-second ...
by sethammons on Thursday November 14, 2019 @10:26AM
(#21536098)
And that would be a good signal and worth investigating. Why timeouts? I run a few services doing billions of daily queries. I watch max in addition to percentiles.
Re:How we built Uber Engineering's highest query-per-second ...
by hobofan on Thursday November 14, 2019 @02:55PM
(#21538762)
> and almost certainly had timeouts, the "max" would also likely be at the timeout
You filter out the 504s, just the same way you would analyze it on a per-route basis for those metrics.
Re:How we built Uber Engineering's highest query-per-second ...
by spookthesunset on Thursday November 14, 2019 @03:03PM
(#21538840)
Sure but now your "100th percentile" would be nothing but the timeout.
Quantifying things like service latency isn't a one-size fits all thing. Every service has its nuances and use cases that make it more meaningful to measure 99%, 99.9%, 99.99% or something else.
.... just don't measure average like I've seen naive junior devs do. Average latency is the worst of all metrics to use as it will include all the outliers at the very tippy top of the spectrum and basically render the metric meaningless.
Given that the service probably did not have a 100% success rate, and almost certainly had timeouts, the "max" would also likely be at the timeout.