News for hackers. Stuff that matters.

A comment on Addressing Recent Claims of “Manipulated” Blog Posts in the Wayback Machine. Parent comment

Re:Addressing Recent Claims of “Manipulated” Blog Posts in t... by mercer on Wednesday April 25, 2018 @05:58AM (#16920046)
Wayback Machine does respect robots.txt, I think. I'm curious what happens if you lose control of your domain, though.
[ Parent | on HN ]
Re:Addressing Recent Claims of “Manipulated” Blog Posts in t... by kevingadd on Wednesday April 25, 2018 @06:05AM (#16920076)
If you lose control the whole history of the site gets nuked by a new robots.txt. This has happened in a few notable cases fairly recently.
[ Parent | on HN ]