News for hackers. Stuff that matters.

A comment on Robots.txt for the NYT has a specific exclusion for an 1996 news article. Parent comment

Re:Robots.txt for the NYT has a specific exclusion for an 19... by bbarnett on Wednesday March 31, 2021 @05:21AM (#26645099)
Use verbatim, as per my comment up thread.
[ Parent | on HN ]

There are no comments on this comment yet.