Re:LWN is currently under the heaviest scraper attack seen yet
by TurdF3rguson on Friday January 16, 2026 @06:11PM
(#46653450)
Sure there is, scrapers do that to defeat throttling. 10,000 is less than 3 hours of scraping at 1 request per second.
[ Parent
| on HN ]
Re:LWN is currently under the heaviest scraper attack seen yet
by Havoc on Friday January 16, 2026 @07:55PM
(#46654243)
It's not 10k requests, it's 10k IPs
Having lots of IPs is helpful for scraping, but you don't need 10k. That's a botnet
Re:LWN is currently under the heaviest scraper attack seen yet
by TurdF3rguson on Friday January 16, 2026 @08:05PM
(#46654297)
The way it works is this: You can sign up for a proxy rotator service that works like a regular proxy except every request you make goes through a different ip address. Is that a botnet? Yes. Is it also typically used in a scraping project? Yes.
Re:LWN is currently under the heaviest scraper attack seen yet
by Havoc on Friday January 16, 2026 @08:39PM
(#46654476)
Yeah I know, I've done scrapping too.
It can absolutely be that, but that requires a confluence of multiple factors - misconfigured scrapper hitting the site over and over, a big bot net like proxy setup that is way overkilled for scrapping, a setup sophisticated enough to do all that yet simultaneously stupid enough to not cope with a site is mostly text and a couple gigs at most and all that over extended timeframe without anyone realising their scrapper is stuck.
Or alternative explanation: It's a DDOS
Re:LWN is currently under the heaviest scraper attack seen yet
by TurdF3rguson on Friday January 16, 2026 @09:54PM
(#46654821)
Except that I think it's clear that the motive was getting the data not taking the site offline. The evidence for that is that it stopped on its own without them doing anything to mitigate it.
Also I don't know why you think this is sophisticated, it's probably 40 lines of Python code max.
Re:LWN is currently under the heaviest scraper attack seen yet
by Havoc on Saturday January 17, 2026 @06:27AM
(#46657190)
No, DDOS do stop on their own too..
This stopping is absolutely not "evidence" that the motive was grabbing data. Honestly...
Re:LWN is currently under the heaviest scraper attack seen yet
by TurdF3rguson on Saturday January 17, 2026 @03:09PM
(#46661559)
Ok so they spent all that money to... mildly inconvenience users temporarily? Lol.