News for hackers. Stuff that matters.

A comment on Devs say AI crawlers dominate traffic, forcing blocks on entire countries. Parent comment

Re:Devs say AI crawlers dominate traffic, forcing blocks on ... by nomel on Wednesday March 26, 2025 @12:20AM (#43478851)
What happens if you use the proper rate limiting status of 429? It includes a next retry time [1]. I'm curious what (probably small) fraction would respect it.

[1] https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/...

[ Parent | on HN ]
Re:Devs say AI crawlers dominate traffic, forcing blocks on ... by karlgkk on Friday March 28, 2025 @02:41AM (#43502237)
Probably makes sense for a b2b app where you publish status codes as part of the api

Bad actors don’t care and annoying actors would make fun of you for it on twitter

[ Parent | on HN ]