News for hackers. Stuff that matters.
Re:The Cost of Being Crawled: LLM Bots and Vercel Image API ... by BonoboIO on Monday April 14, 2025 @08:47PM (#43687896)
Absolutely insane pricing, maybe for small blogs, but didn’t they calculate this trough?

Millions of episode, of course they will be visited and the optimization is run.

Re:The Cost of Being Crawled: LLM Bots and Vercel Image API ... by ilyabez on Tuesday April 15, 2025 @03:35AM (#43689999)
Hi, I'm the author of the blog (though I didn't post it on HN).

The site was originally secondary to our business and was built by a contractor. It was secondary to our business and we didn't pay much attention until we actually added the episode pages and the bots discovered them.

I saw a lot of disparaging comments here. It's definitely our fault for not understanding the implications of what the code was doing. We didn't mention the contractor in the post, because we didn't want to throw them under the bus. The accountability is all ours.