Re:AI bots everywhere. Does anyone have a good whitelist for...
by keisborg on Wednesday January 29, 2025 @01:00AM
(#42862021)
An old trick is to add a page to the robots disallow list, but the page should also be findable by crawlers. If a bot visits this page, you know it’s a bad actor.
[ Parent
| on HN ]