News for hackers. Stuff that matters.
Re:More than 9M broken links on Wikipedia are now rescued by zaarn on Tuesday October 02, 2018 @03:01AM (#18119366)
You can do this if you group all site visits into one common WARC and compress it (or dedup it otherwise).

WARC itself does have a method of dedup if the response is the same (or mostly the same) but terrible if content changes.

There are no comments on this comment yet.