News for hackers. Stuff that matters.
Re:Optimizating Rabin-Karp Hashing by def-lkb on Saturday March 09, 2024 @03:39AM (#39650366)
Compression, synchronization and backup systems often use rolling hash to implement "content-defined chunking", an effective form of deduplication.

In optimized implementations, Rabin-Karp is likely to be the bottleneck. See for instance https://github.com/facebook/zstd/pull/2483 which replaces a Rabin-Karp variant by a >2x faster Gear-Hashing.

There are no comments on this comment yet.