Re:Does Cloudflare's 1.1.1.1 DNS Block Archive.is? (2019)
by deadalus on Saturday September 11, 2021 @05:00PM
(#28495934)
archive.org obeys the robots.txt exclusion but archive.today doesn't. This means that many websites(like 4chan) cannot be archived with archive.org.
[ Parent
| on HN ]