News for hackers. Stuff that matters.
Re:The Internet Archive is waging war on misinformation by ent101 on Wednesday September 18, 2019 @04:05PM (#21009485)
Just to be clear, the data doesn't seem to be deleted -- it only becomes inaccessible once the site opts out; all the data can come back if the site changes its mind.
Re:The Internet Archive is waging war on misinformation by pishpash on Wednesday September 18, 2019 @06:00PM (#21010732)
Does it also continue to archive while the 'do not archive' flag is on?
Re:The Internet Archive is waging war on misinformation by ent101 on Wednesday September 18, 2019 @10:40PM (#21012739)
I'm not sure, but I do think they follow the standard guidelines, meaning they won't archive if the flag is on. This can be verified by going through the Heritrix crawler's source code.