News for hackers. Stuff that matters.

A comment on AI bots everywhere. Does anyone have a good whitelist for robots.txt?.

Re:AI bots everywhere. Does anyone have a good whitelist for... by captn3m0 on Tuesday January 28, 2025 @11:15PM (#42861438)
I’ve been using https://github.com/ai-robots-txt/ai.robots.txt on my Gitea instance.
[ Parent | on HN ]

There are no comments on this comment yet.