Re:Wikipedia deprecates Archive.today, starts removing archi...
by super256 on Friday February 20, 2026 @07:02PM
(#47095817)
You don't even need to do requests if you are the owner of the URL. Robot.txt changes are applied in retrospect, which means you can disallow crawls to /abc, request a re-crawl, and all snapshots from the past which match this new rule will be removed.
[ Parent
| on HN ]
There are no comments on this comment yet.