Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on We should start to add “ai.txt” as we do for “robots.txt”. Parent comment
That depends what you expect from it. For the purpose of limiting crawlers, at least the major search engines respect it.
There are no comments on this comment yet.
That depends what you expect from it. For the purpose of limiting crawlers, at least the major search engines respect it.