News for hackers. Stuff that matters.
Re:How Mailinator compresses its email stream by 90% by jorangreef on Wednesday February 22, 2012 @01:04AM (#3619676)
Something else that might work is content-dependent deduplication, with variable chunk boundaries determined by a sliding Rabin-Karp-style (or XOR) fingerprint on the content and a second cryptographic hash calculated for chunks where the cheap fingerprint has a match. It's naive and can find matches across headers, body and attachment parts.

There are no comments on this comment yet.