Re:Content Independence Day: no AI crawl without compensation
by techjamie on Wednesday July 02, 2025 @04:56PM
(#44448720)
Many of these tarpits deliberately serve the data at an excruciatingly low speed to ease the burden on the server resources. It's cheaper than quickly serving the same crawlers your entire website at max speed constantly.
[ Parent
| on HN ]
Re:Content Independence Day: no AI crawl without compensation
by OutOfHere on Wednesday July 02, 2025 @08:12PM
(#44450221)
If we are going for cheaper, how is it cheaper than an HTTP 429 error? It's not.