News for hackers. Stuff that matters.

A comment on Robots.txt for the NYT has a specific exclusion for an 1996 news article. Parent comment

Re:Robots.txt for the NYT has a specific exclusion for an 19... by rurban on Monday March 29, 2021 @01:30PM (#26625274)
You wont find anything, as it was taken down a few days after publication. The NY Times article was taken down later, but had not much juicy info.
[ Parent | on HN ]

There are no comments on this comment yet.