News for hackers. Stuff that matters.
Re:Cloudflare Radar by drcongo on Wednesday September 30, 2020 @11:11AM (#24639544)
A site for one of my clients was, at one point, getting absolutely hammered by a bot that crawls for plagiarised content. It was ignoring our robots.txt so I ended up blocking it via CloudFlare. There are bots for pretty much anything you can think of out there.

edit: replaced "scrapes" with "crawls" for accuracy.

There are no comments on this comment yet.