Re:News publishers limit Internet Archive access due to AI s...
by heavyset_go on Sunday February 15, 2026 @07:32AM
(#47023190)
HEAD requests
[ Parent
| on HN ]
Re:News publishers limit Internet Archive access due to AI s...
by Findecanor on Sunday February 15, 2026 @09:16AM
(#47023839)
Scrapers could also use the "Cache-Control", "Expires" and "If-Modified-Since" headers properly, to reduce their traffic a little, but do they?