News for hackers. Stuff that matters.
Re:Ask HN: How to stop an AWS bot sending 2B requests/month by CWuestefeld on Monday October 20, 2025 @07:42PM (#45650809)
Oh, lord yes! Frequently they're scraping us from multiple distinct CIDR blocks simultaneously. But we can tell it's the same organization doing it not just because the requests look similar, but it's even possible occasionally to see a request for a search from one CIDR that's followed up immediately by requests for details for the products that had been returned by the search.

While at the same time, because our site is B2B ecommerce, where our typical customer is a decent-sized corporation, it's not uncommon for a single legit user to have consecutive requests originate from different IPs, as their internal proxies use different egress points.

There are no comments on this comment yet.