News for hackers. Stuff that matters.
Re:Let us serve you, but don't bring us down by RugnirViking on Monday May 29, 2023 @04:33AM (#36111964)
I hate to be a pedant but I see it used wrong a lot. "DDOS" stands for Distributed denial of service, specifically indicating the traffic is coming from many sources (wide range of ip), which is what makes it so hard to defend against. Someone scraping too fast would be performing an unintentional DOS, because they probably arent scraping using a botnet (and if they were they probably do in fact intend to attack)
Re:Let us serve you, but don't bring us down by jakear on Monday May 29, 2023 @05:14AM (#36112171)
And if they’re scraping using “serverless” compute? It’s distributed, but could be used without “meaning” to attack. That seems to be what happened to Archive (they said AWS, could be ECS or Lambda, idk).

FWIW this thread inspired me to implement Cloudflare Turnstile on one of my pages - highly recommend. As compared to reCAPTCHA your users are never wasting their life away clicking on traffic signs, and as compared to mCaptcha you don’t have to host the server yourself.

Re:Let us serve you, but don't bring us down by geraldwhen on Monday May 29, 2023 @07:19AM (#36112857)
Extremely unlikely that was lambda unless the user liked to light money on fire.
Re:Let us serve you, but don't bring us down by jakear on Monday May 29, 2023 @09:13AM (#36113625)
Well they were an "AI Startup"....
Re:Let us serve you, but don't bring us down by marginalia_nu on Monday May 29, 2023 @06:11AM (#36112458)
In practice they're often using botnets. It's what makes this such a difficult problem to deal with. If they weren't it would be trivial to rate-limit or block problematic IPs or subnets.
Re:Let us serve you, but don't bring us down by RugnirViking on Monday May 29, 2023 @04:22PM (#36117669)
as I mentioned in the post: why would a legitimate scraper be using a botnet?
Re:Let us serve you, but don't bring us down by marginalia_nu on Tuesday May 30, 2023 @03:02AM (#36121925)
In most cases, they aren't legitimate scrapers. They have a complete disregard for the resources they use from the websites they scrape and use a botnet to hide their point of origin.
Re:Let us serve you, but don't bring us down by tiagod on Monday May 29, 2023 @06:38AM (#36112595)
Even if their scraping operation is centralized, it's common to use residential proxy providers which spread the activity over a big number of IPs.