News for hackers. Stuff that matters.
Re:Show HN: Stop AI scrapers from hammering your self-hosted... by cuku0078 on Friday December 19, 2025 @07:08AM (#46324938)
Why is it so bad that AIs scrape your self-hosted blog?
Re:Show HN: Stop AI scrapers from hammering your self-hosted... by FelipeCortez on Friday December 19, 2025 @07:10AM (#46324947)
because serving requires resources
Re:Show HN: Stop AI scrapers from hammering your self-hosted... by cuku0078 on Friday December 19, 2025 @10:29AM (#46326855)
What specific resources are we referring to here? Are AI vendors re-crawling the whole blog repeatedly, or do they rely on caching primitives like ETag/If-Modified-Since (or hashes) to avoid fetching unchanged posts? Also: is the scraping volume high enough to cause outages for smaller sites?

Separately, I see a bigger issue: blog content gets paraphrased and reproduced by AIs without clearly mentioning the author or linking back to the original post. It feels like you often have to explicitly ask the model for sources before it will surface the exact citations.