Re:ChatGPT won't let you type until Cloudflare reads your Re...
by gzread on Monday March 30, 2026 @01:31AM
(#47570693)
If you can identify the scraper you should have a valid legal case to recover damages.
Re:ChatGPT won't let you type until Cloudflare reads your Re...
by thisislife2 on Monday March 30, 2026 @10:37AM
(#47574942)
Only if they had a robots.txt for their site.
Re:ChatGPT won't let you type until Cloudflare reads your Re...
by razingeden on Monday March 30, 2026 @10:58AM
(#47575177)
I hadn’t even considered that. Don’t know why that comment is greyed out or downvoted.
It’s a static site that hasn’t been updated since 2016—- so it’s .. since been moved to cloudflare r2 where it’s getting a $0.00 bill, and it now has a disallow / directive. I’m not sure if it’s being obeyed because the cf dash still says it’s getting 700-1300 hits a day even with all the anti bot, “cf managed robots” stuff for ai crawlers in there.
The content is so dry and irrelevant I just can’t even fathom 1/100th of that being legitimate human interest but I thought these things just vacuumed up and stole everyone’s content instead of nailing their pages constantly?
Re:ChatGPT won't let you type until Cloudflare reads your Re...
by gzread on Monday March 30, 2026 @11:02AM
(#47575239)
No, it's still illegal to DDoS sites that don't have robots.txt.
Re:ChatGPT won't let you type until Cloudflare reads your Re...
by thisislife2 on Monday March 30, 2026 @11:46AM
(#47575773)
You are right, I hadn't considered that aspect.
It hasn’t even been updated in years so hell if I know why it needs to be fetched constantly and aggressively, - but fuck every single one of these companies now whining about bots scraping and victimizing them, here’s my violin.