News for hackers. Stuff that matters.
Re:Devs say AI crawlers dominate traffic, forcing blocks on ... by Nckpz on Tuesday March 25, 2025 @11:10PM (#43478492)
I recently started a side-project with a "code everything in prod" approach for fun. I've done this many times over the past 20 years and the bot traffic is usually harmless, but this has been different. I haven't advertised the hostname anywhere, and in less than 24 hours I had a bunch of spam form submissions. I've always expected this after minor publicity, but not "start server, instantly get raided by bots performing interactions"
Re:Devs say AI crawlers dominate traffic, forcing blocks on ... by ndiddy on Tuesday March 25, 2025 @11:34PM (#43478620)
This is yet another great example of the innovation that the AI industry is delivering. Why just limit your scraper bots to GET requests when there might be some juicy data to train on hidden behind that form? There's a reason why the a16z funded cracked vibe coder ninjas are taking over software engineering, they're full of wonderful ideas like this.
Re:Devs say AI crawlers dominate traffic, forcing blocks on ... by ohgr on Wednesday March 26, 2025 @04:03AM (#43479883)
I work with one of those guys. Morally bankrupt at every level of his existence.
Re:Devs say AI crawlers dominate traffic, forcing blocks on ... by bendangelo on Wednesday March 26, 2025 @01:30AM (#43479137)
There are bots that scrape https registration sites thats how they usually find you.