Re:Show HN: Stop AI scrapers from hammering your self-hosted...
by drclegg on Friday December 19, 2025 @05:47AM
(#46324362)
> So fuzzycanary also checks user agents
I wouldn't be so surprised if they often fake user agents to be honest. Sure, it 'll stop the "more honest" ones (but then, actual honest scrapers would respect robots.txt)
I wouldn't be so surprised if they often fake user agents to be honest. Sure, it 'll stop the "more honest" ones (but then, actual honest scrapers would respect robots.txt)
Cool idea though!