Cloudflare adds option to block AI scrapers and crawlers

Re:Cloudflare adds option to block AI scrapers and crawlers by Daunk on Thursday June 27, 2024 @04:08PM (#40814527)

Didn't they add this last year?

[ Parent | on HN ]

Re:Cloudflare adds option to block AI scrapers and crawlers by SpaceManNabs on Thursday June 27, 2024 @04:09PM (#40814547)

Glad to see the repost. I am going to check if I have this enabled. didn't know this feature existed.

[ Parent | on HN ]

Re:Cloudflare adds option to block AI scrapers and crawlers by bakugo on Thursday June 27, 2024 @04:20PM (#40814650)

I'm guessing the option to block AI bots using WAF rules has been available since last year, but this simple toggle on/off option is recent (though, all it does is create a WAF rule for you, which seemingly counts towards the WAF rule limit)

[ Parent | on HN ]

Re:Cloudflare adds option to block AI scrapers and crawlers by xbar on Thursday June 27, 2024 @05:54PM (#40815577)

I thought so. I wish they had added it 5 years ago.

[ Parent | on HN ]