News for hackers. Stuff that matters.
Re:Newsgroups and the Internet Archive: I Made a Difference by brokensegue on Sunday March 25, 2018 @01:12PM (#16673161)
wayback machine's archive of reddit isn't perfect but it works. just give the IA more money
Re:Newsgroups and the Internet Archive: I Made a Difference by Asparagirl on Sunday March 25, 2018 @01:26PM (#16673246)
Yes, but much of the Wayback Machine’s reddit content was specifically targeted and scraped by ArchiveTeam, who are volunteers that seek out at-risk content from the web and make sure that it gets into the Wayback. In the past few years we’ve specifically tried to go after sub-reddits that we thought were newsworthy and/or at high risk for deletion. But there’s no way we can get all of it.

But you can help! If you have extra server space/bandwidth or you can spare $40/month, we can add more pipelines: https://www.archiveteam.org/index.php/ArchiveBot

Source: am ArchiveTeam member, run various pipelines, have scraped sub-reddits ranging from The_Donald to the cryptocurrency worlds to darknet markets.