News for hackers. Stuff that matters.
Re:Ask HN: What do people use to prevent crawlers? by alexcnwy on Sunday July 23, 2017 @07:33AM (#14831781)
Plus very easy to parallelize
Re:Ask HN: What do people use to prevent crawlers? by amelius on Sunday July 23, 2017 @11:27AM (#14832672)
Unless the websites work together to protect themselves against crawlers that work that way (e.g., rejecting requests to different hosts from the same origin within a time interval).