Re:Newsgroups and the Internet Archive: I Made a Difference
by jl6 on Sunday March 25, 2018 @02:27AM
(#16671049)
Reddit is the current era’s equivalent of Usenet, and we don’t have a robust archive of that either.
[ Parent
| on HN ]
Re:Newsgroups and the Internet Archive: I Made a Difference
by brokensegue on Sunday March 25, 2018 @01:12PM
(#16673161)
wayback machine's archive of reddit isn't perfect but it works. just give the IA more money
Re:Newsgroups and the Internet Archive: I Made a Difference
by Asparagirl on Sunday March 25, 2018 @01:26PM
(#16673246)
Yes, but much of the Wayback Machine’s reddit content was specifically targeted and scraped by ArchiveTeam, who are volunteers that seek out at-risk content from the web and make sure that it gets into the Wayback. In the past few years we’ve specifically tried to go after sub-reddits that we thought were newsworthy and/or at high risk for deletion. But there’s no way we can get all of it.
But you can help! If you have extra server space/bandwidth or you can spare $40/month, we can add more pipelines: https://www.archiveteam.org/index.php/ArchiveBot
Source: am ArchiveTeam member, run various pipelines, have scraped sub-reddits ranging from The_Donald to the cryptocurrency worlds to darknet markets.