We can't have nice things because of AI scrapers

Re:We can't have nice things because of AI scrapers by accrual on Tuesday January 13, 2026 @06:30PM (#46610019)

Grateful for Metabrainz putting in this work to keep the service up. We really ought to have some kind of "I am an AI!" signal to route the request properly into a long queue...

[ Parent | on HN ]

Re:We can't have nice things because of AI scrapers by gamer191 on Tuesday January 13, 2026 @06:39PM (#46610122)

Companies wouldn’t send it because they know that most websites would block them

[ Parent | on HN ]

Re:We can't have nice things because of AI scrapers by zerocrates on Wednesday January 14, 2026 @01:37AM (#46613042)

Yeah, they can just set the evil bit in their IP packets.

[ Parent | on HN ]

Re:We can't have nice things because of AI scrapers by jeroenhd on Wednesday January 14, 2026 @04:58AM (#46614222)

AI scrapers already fake user agent headers, ignore robots.txt, and go through botnets to bypass firewall rules. They're not going to put out such a signal if they can help it.

[ Parent | on HN ]