News for hackers. Stuff that matters.
Re:Probabilistic Filters By Example: Cuckoo Filter and Bloom... by teraflop on Tuesday July 19, 2016 @07:55PM (#12125844)
Also the "Insertions may be rejected" thing would be a deal-breaker for a lot of applications.

If you can't guarantee that an insert will be successful, then you have to be willing to either tolerate false positives and false negatives, or throw away the cuckoo filter and re-create it from scratch.

Re:Probabilistic Filters By Example: Cuckoo Filter and Bloom... by bdupras on Wednesday July 20, 2016 @08:31PM (#12133672)
Yeah, absolutely. You get the same "feature" from Counting Blooms - i.e. if an insertion would overflow any of the counters, the filter can knowingly reject the insertion.

This is both a feature and a limitation. In our use case, our filter grows predictably, and every few months a rejected insertion triggers a resize/rebuild from source data. Because we could tolerate a full rebuild, we chose for now not to implement the technique of growing the filter by adding successively larger filter segments with lower fpp guarantees, though that is an option.