News for hackers. Stuff that matters.
Re:SeenBefore: A search engine for what you have seen before by StavrosK on Monday September 24, 2012 @09:16PM (#4568001)
Why not use a bloom filter?
Re:SeenBefore: A search engine for what you have seen before by vidarh on Tuesday September 25, 2012 @05:09AM (#4569369)
The main benefit of Bloom filters is that they can be made small. Given that his database takes only 70MB or so and he's not trying to ship this to devices that might have much in terms of space limitations, there would appear to be little point.
Re:SeenBefore: A search engine for what you have seen before by StavrosK on Tuesday September 25, 2012 @05:13AM (#4569380)
Eh, true, I guess redis is sufficiently awesome.
Re:SeenBefore: A search engine for what you have seen before by genwin on Tuesday September 25, 2012 @12:50AM (#4568641)
Maybe because of this fact (according to Wikipedia)?: "The more elements that are added to the set, the larger the probability of false positives."
Re:SeenBefore: A search engine for what you have seen before by StavrosK on Tuesday September 25, 2012 @05:13AM (#4569379)
That depends on its size, though. You can make it larger and get fewer false positives.