News for hackers. Stuff that matters.

A comment on Algorithms Every Programmer Should Know: Reservoir Sampling. Parent comment

Re:Algorithms Every Programmer Should Know: Reservoir Sampling by bradleyjg on Friday March 06, 2015 @02:23PM (#9158963)
Imagine you are writing software to sit on a router to:

1) collect data for some length of time, and

2) thereafter have available for querying the (maybe approximate) 25th, 50th, 95th, and 99th percentile TCP connection bandwidth thresholds, and

3) signal when a connection grows beyond the 95th percentile.

You only have a fairly limited amount of memory.

[ Parent | on HN ]
Re:Algorithms Every Programmer Should Know: Reservoir Sampling by x0x0 on Friday March 06, 2015 @10:09PM (#9160828)
While it's great for medians, reservoir sampling for calculating high or low percentiles, particularly with high dynamic range data, will probably have very high error.
[ Parent | on HN ]