Cloudflare Introduces Default Blocking of A.I. Data Scrapers

Re:Cloudflare Introduces Default Blocking of A.I. Data Scrapers by Bender on Wednesday July 02, 2025 @01:26PM (#44446412)

For my silly hobby sites I just return status 444 close the connection for anything that has case-insentive "bot" in the UA requesting anything other than robots.txt, humans.txt, favicon.ico, etc... This would also drop search engines but I blackhole route most of their CIDR blocks. I'm probably the only one here that would do this.

[ Parent | on HN ]

Re:Cloudflare Introduces Default Blocking of A.I. Data Scrapers by sneak on Wednesday July 02, 2025 @05:42PM (#44449162)

How does a bot scraping your silly hobby sites for any purpose harm or negatively affect you in any way?

[ Parent | on HN ]

Re:Cloudflare Introduces Default Blocking of A.I. Data Scrapers by pixl97 on Wednesday July 02, 2025 @07:54PM (#44450110)

Depends if they hit a site enough to make it cost something. It's not hard for bots to flood servers.

[ Parent | on HN ]

Re:Cloudflare Introduces Default Blocking of A.I. Data Scrapers by Bender on Thursday July 03, 2025 @07:39AM (#44453972)

Only if they push me over my bandwidth limits but they can't do that if I just drop them on the floor.

[ Parent | on HN ]