News for hackers. Stuff that matters.
Re:AI bots everywhere. Does anyone have a good whitelist for... by keisborg on Wednesday January 29, 2025 @01:00AM (#42862021)
An old trick is to add a page to the robots disallow list, but the page should also be findable by crawlers. If a bot visits this page, you know it’s a bad actor.
Re:AI bots everywhere. Does anyone have a good whitelist for... by foreigner on Wednesday January 29, 2025 @03:44AM (#42862875)
I love this idea! Can anybody else with experience with this chime in? Does it actually work?