Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Google killer-robots.txt. Parent comment
Disallow: tells the robot that it should not visit those particular pages on a site. Or in this case, terminate those individuals.
There are no comments on this comment yet.
Disallow: tells the robot that it should not visit those particular pages on a site. Or in this case, terminate those individuals.