Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on AI scrapers request commented scripts. Parent comment
If what you're protecting with robots.txt isn't copyright-able, then you'll need to find another legal means.
There are no comments on this comment yet.
If what you're protecting with robots.txt isn't copyright-able, then you'll need to find another legal means.