News for hackers. Stuff that matters.

A comment on AI bots everywhere. Does anyone have a good whitelist for robots.txt?. Parent comment

Re:AI bots everywhere. Does anyone have a good whitelist for... by foreigner on Wednesday January 29, 2025 @03:44AM (#42862875)
I love this idea! Can anybody else with experience with this chime in? Does it actually work?
[ Parent | on HN ]

There are no comments on this comment yet.