Gentoo bugzilla closed due AI bot scraper overload

Re:Gentoo bugzilla closed due AI bot scraper overload by c-fe on Saturday August 08, 2026 @10:37AM (#49222237)

going on a bit of a tangent here - some discussion there seems to be imply that AI bots mostly use IPv4s, which makes sense to me given that they are probably bots hosted by some cloud. Whereas IPv6 may be more organic traffic from e.g. mobile users (not in this case probably)... which made me think if at some point IPv6 may at some point win against IPv4 just because its more organic traffic (i.e. not from big tech cloud), leading to pages blocking IPv4? Just speculation on my side

[ Parent | on HN ]

Re:Gentoo bugzilla closed due AI bot scraper overload by Retr0id on Saturday August 08, 2026 @11:01AM (#49222485)

The hardest-to-mitigate bot traffic tends to come from residential proxies, and most residential connections are still v4-only.

However, it is also easy to get large numbers of v6 addresses cheaply.

[ Parent | on HN ]

Re:Gentoo bugzilla closed due AI bot scraper overload by neuroticnews25 on Saturday August 08, 2026 @10:56AM (#49222446)

This is weird, every VPS I've rented in the last 8 years had IPv6, and some didn't even had IPv4.

[ Parent | on HN ]

Re:Gentoo bugzilla closed due AI bot scraper overload by TingPing on Saturday August 08, 2026 @11:41AM (#49222884)

If a problematic bot is on any mainstream VPS it will just get shut down.

[ Parent | on HN ]

Re:Gentoo bugzilla closed due AI bot scraper overload by Symbiote on Saturday August 08, 2026 @11:46AM (#49222923)

How would I shut down a bot on Digital Ocean making over a million requests a day?

[ Parent | on HN ]

Re:Gentoo bugzilla closed due AI bot scraper overload by coldbrewed on Saturday August 08, 2026 @12:08PM (#49223112)

Send an email to the Digitalocean abuse email with the time ranges and origin IPs.

[ Parent | on HN ]

Re:Gentoo bugzilla closed due AI bot scraper overload by neuroticnews25 on Saturday August 08, 2026 @02:04PM (#49224244)

I did this with OVH, never got any response.

[ Parent | on HN ]

Re:Gentoo bugzilla closed due AI bot scraper overload by progval on Saturday August 08, 2026 @02:33PM (#49224529)

abuse@ contacts never send responses (though some send acknowledgements) because they don't want to give any details about their abuse process.

[ Parent | on HN ]

Re:Gentoo bugzilla closed due AI bot scraper overload by thayne on Saturday August 08, 2026 @12:53PM (#49223522)

My residential ISP doesn't support IPv6 at all. If a site is ipv6 only, I can't reach it unless I use a VPN.

[ Parent | on HN ]