Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Show HN: Robots.txt generator for blocking AI crawlers.
How more useful tool would be something that generates a piece of web server config to actually block bots.
There are no comments on this comment yet.
How more useful tool would be something that generates a piece of web server config to actually block bots.