Re:Does Cloudflare's 1.1.1.1 DNS Block Archive.is? (2019)
by deadalus on Saturday September 11, 2021 @05:00PM
(#28495934)
archive.org obeys the robots.txt exclusion but archive.today doesn't. This means that many websites(like 4chan) cannot be archived with archive.org.
Re:Does Cloudflare's 1.1.1.1 DNS Block Archive.is? (2019)
by oenetan on Saturday September 11, 2021 @05:08PM
(#28496040)
That's true, so does webcitation.org, which doesn't obey robots.txt.
4chan has archives dedicated for that site anyway (Warosu, etc.).
Re:Does Cloudflare's 1.1.1.1 DNS Block Archive.is? (2019)
by Jerry2 on Saturday September 11, 2021 @05:13PM
(#28496087)
>Everything on archive.is is on archive.org. I would say 99% of stuff.
Given how a LOT of the stuff today is behind paywalls and Archive.today breaks through most of them and Archive.org doesn't, your "99%" figure is way, way off when it comes to popular stuff.
Anyway, I donate to both the Archive.today and Archive.org. They're extremely valuable to me. I feel like Archive.today is in a dire situation when it comes to funding so I donate more than double to them each month.
If you're able, please donate to these sites. They are running on fumes. And take a look at my profile for a list of other orgs to donate to.
If archive.is goes down we have webcitation.org, etched.page, ghostarchive.org, webrecorder.net, etc....