News for hackers. Stuff that matters.
Re:Common Crawl by d110af5ccf on Friday March 26, 2021 @07:29PM (#26598237)
> Cloudflare's protection is to guard against traffic spikes and automated malicious attacks

This simply isn't true. By my reading, Cloudflare implies any automated traffic that doesn't openly advertise itself as such is bad. They certainly seem to be happy to assist you in blocking it regardless of whether it was actually malicious or actually causing traffic problems. (https://blog.cloudflare.com/super-bot-fight-mode/)

Re:Common Crawl by shadowgovt on Friday March 26, 2021 @07:38PM (#26598310)
I'm not sure I understand the distinction you're making. Automated traffic that isn't flagging itself as automated is deceptive, and that's a negative signal for maliciousness right out of the starting gate.
Re:Common Crawl by ipaddr on Friday March 26, 2021 @09:59PM (#26599174)
Shouldn't automated traffic be allowed privacy? To not do so means we have to take away privacy from humans in order to verify they are not automated. What do we gain for this? Why shouldn't some programmable bot be allowed to see my content but any human no matter their intent are allowed by default?
Re:Common Crawl by fjeifisjf on Saturday March 27, 2021 @08:44AM (#26601906)
Bots don’t have human. They are identifiable by behavior. If they aren’t, there’s no problem.
Re:Common Crawl by shadowgovt on Friday March 26, 2021 @10:05PM (#26599202)
> What do we gain for this?

More reliable services for those willing to de-pssudonymize and declare themselves in an auditable fashion.