News for hackers. Stuff that matters.
Re:LWN is currently under the heaviest scraper attack seen yet by ofrzeta on Friday January 16, 2026 @10:14PM (#46654904)
Recently I needed to block some scrapers to execessive load on a server, and here are some that I identified:

BOTS=( "semrushbot" "petalbot" "aliyunsecbot" "amazonbot" "claudebot" "thinkbot" "perplexitybot" "openai.com/bot" )

This was really just emergency blocking and it included more than 1500 IP addresses.

Here's Amazon's page about their bot with more information including IP addresses

https://developer.amazon.com/amazonbot

There are no comments on this comment yet.