Re:Perks – Effectively compute quantiles for unbounded data ...
by vosper on Monday April 15, 2013 @06:47PM
(#5554989)
I don't really understand what this does, I didn't find a "for dummies" section on the site - can anyone give a real-world use case and (ideally) a comparison with some other system that does the same thing?
[ Parent
| on HN ]
Re:Perks – Effectively compute quantiles for unbounded data ...
by bmizerany on Monday April 15, 2013 @06:54PM
(#5555021)
azmenthe's article covers the problem well: http://blog.tempo-db.com/post/42318820124/estimating-percent...
Basically, when you have more data than memory and time to sort them in order to find the percentile you're looking for, you need to employ an algorithm that trades rank selection accuracy for lower memory and CPU costs. This package does that.