News for hackers. Stuff that matters.

A comment on AI bots everywhere. Does anyone have a good whitelist for robots.txt?. Parent comment

Re:AI bots everywhere. Does anyone have a good whitelist for... by memhole on Wednesday January 29, 2025 @02:28AM (#42862498)
I personally don’t even bother with it for these reasons.
[ Parent | on HN ]

There are no comments on this comment yet.