News for hackers. Stuff that matters.
Re:FOSS infrastructure is under attack by AI companies by megadata on Thursday March 20, 2025 @09:18AM (#43422855)
Perhaps time to start a central community ban pool for IP ranges?
Re:FOSS infrastructure is under attack by AI companies by MartijnBraam on Thursday March 20, 2025 @09:21AM (#43422910)
Doesn't really work if crawlers are coming from the IP ranges of AWS and Azure etc...
Re:FOSS infrastructure is under attack by AI companies by megadata on Thursday March 20, 2025 @09:57AM (#43423510)
AWS and Azure can be blocked like anyone else.
Re:FOSS infrastructure is under attack by AI companies by blibble on Thursday March 20, 2025 @09:29AM (#43423049)
just ban the lot

nothing good comes from there

unfortunately then they instantly switch to home IPs

Re:FOSS infrastructure is under attack by AI companies by immibis on Thursday March 20, 2025 @09:29AM (#43423041)
Traditionally, holders of IP ranges that attack the internet at large get kicked off the internet by having those ranges blacklisted everywhere. This can also get them in serious trouble with the places they got their IP ranges (I assume AWS has them directly from ARIN, so maybe not) and their upstream bandwidth providers and so on, as well as making them less attractive hosts because they are blocked everywhere.
Re:FOSS infrastructure is under attack by AI companies by mrweasel on Thursday March 20, 2025 @10:02AM (#43423616)
Kicking AWS of the internet would effectively break half of everything. So much stuff is relying on services running on AWS that it's not even funny.

We've seen random stuff break when AWS has had outages, not because we used AWS ourselves, but because suppliers do.

Re:FOSS infrastructure is under attack by AI companies by megadata on Thursday March 20, 2025 @10:19AM (#43423898)
You don't need to kick anyone off the internet. Just ban them for accessing your resources.
Re:FOSS infrastructure is under attack by AI companies by mrweasel on Thursday March 20, 2025 @10:23AM (#43423936)
No, but the suggestion from the parent comment was to have the holder of the offending IP ranges kicked off the internet.

Technically I'm all for kicking AWS off the internet for a day or to, for failing to police their customers, but it would just break a lot.

Re:FOSS infrastructure is under attack by AI companies by curtisblaine on Thursday March 20, 2025 @12:44PM (#43425564)
That's actually an argument in favour of kicking AWS off the Internet. We rely too much on their services, to the point we're afraid of banning their IPs if they do something bad. Better stop this now than being worse off later. The best moment would have been ten years ago, the second best moment is today.
Re:FOSS infrastructure is under attack by AI companies by Tostino on Thursday March 20, 2025 @09:28AM (#43423020)
Or sometimes they use consumer IP proxies. Makes it even harder because sometimes those IPs get reused for actual users.
Re:FOSS infrastructure is under attack by AI companies by megadata on Thursday March 20, 2025 @09:57AM (#43423535)
Block them for 24 hours.
Re:FOSS infrastructure is under attack by AI companies by Galanwe on Thursday March 20, 2025 @09:30AM (#43423061)
There's already loads of these. The problem is that most of these IPs are just cloud providers or DC ISPs.
Re:FOSS infrastructure is under attack by AI companies by tecleandor on Thursday March 20, 2025 @10:03AM (#43423623)
Or even worse, lots of them are using barely legal residential proxies so the requests are coming from everywhere. In Drew DeVault's article linked in this post he complained precisely about the residential-looking source IP addresses [0]. And I think I remember something about a Chinese company, some months ago, very aggressively scraping using that method.

Companies like DataImpulse [1] or ScraperAPI [2] will happily publicize their services with that specific target.

--

  0: https://drewdevault.com/2025/03/17/2025-03-17-Stop-externalizing-your-costs-on-me.html
  1: https://dataimpulse.com/use-cases/ai-proxies/
  2: https://www.scraperapi.com/solutions/ai-data/
Re:FOSS infrastructure is under attack by AI companies by tremon on Thursday March 20, 2025 @01:56PM (#43426591)
Are these "residential proxies" assumed to be infected devices part of a botnet or malicious apps on users' phones?
Re:FOSS infrastructure is under attack by AI companies by Galanwe on Thursday March 20, 2025 @04:50PM (#43428785)
A lot of these residential proxy as a service companies just use regular ISPs to run their automated headless browsers. It doesn't need to be illegal.
Re:FOSS infrastructure is under attack by AI companies by prmoustache on Thursday March 20, 2025 @07:50PM (#43430371)
I guess iot devices and mobile apps.

Unethical, definitely. Illegal, no.

Re:FOSS infrastructure is under attack by AI companies by megadata on Thursday March 20, 2025 @10:20AM (#43423909)
> There's already loads of these

Examples?