Re:BuzzFeed Says Posts Were Deleted Because of Advertising P...
by jamesbrownuhh on Sunday April 19, 2015 @06:42AM
(#9402698)
Putting the article URL in robots.txt stops the Wayback machine from displaying it - that's why they do it, just in case the Internet Archive happened to have a cached copy of the article.
[ Parent
| on HN ]