News for hackers. Stuff that matters.

A comment on LWN is currently under the heaviest scraper attack seen yet. Parent comment

Re:LWN is currently under the heaviest scraper attack seen yet by delfinom on Friday January 16, 2026 @06:05PM (#46653409)
As someone that runs the infrastructure for a large OSS project. Mostly Chinese AI firms. All the big name brand AI firms play reasonably nice and respect robots.txt.

The Chinese ones are hyper aggressive, with no rate limit and pure greed scraping. They'll scrape the same content hundreds of times the same day

[ Parent | on HN ]
Re:LWN is currently under the heaviest scraper attack seen yet by rfmoz on Friday January 16, 2026 @06:46PM (#46653722)
Chinese AI is doing large amounts of request in the past weeks.
[ Parent | on HN ]
Re:LWN is currently under the heaviest scraper attack seen yet by tjons on Friday January 16, 2026 @08:22PM (#46654391)
how is this showing up for you? site you host or bigger scale? I'm not surprised but rather curious.
[ Parent | on HN ]
Re:LWN is currently under the heaviest scraper attack seen yet by suburban_strike on Friday January 16, 2026 @08:28PM (#46654419)
The Chinese are also sloppy. They will run those scrapers until they get banned and not give a fuck.

In my experience, they do not bother putting in the effort to obfuscate source or evade bans in the first place. They might try again later, but this particular setup was specifically engineered for resiliency.

[ Parent | on HN ]
Re:LWN is currently under the heaviest scraper attack seen yet by bediger4000 on Friday January 16, 2026 @08:37PM (#46654465)
Is this an example of that "chabuduo" we read about now and then?
[ Parent | on HN ]