News for hackers. Stuff that matters.
Re:The Cost of Being Crawled: LLM Bots and Vercel Image API ... by ilyabez on Tuesday April 15, 2025 @03:45AM (#43690050)
Hi, I'm the author of the blog (though I didn't post it on HN).

We're going to put Cloudflare in front of our Vercel site and control cache for SSR pages with Cache-Control headers.

Re:The Cost of Being Crawled: LLM Bots and Vercel Image API ... by CharlieDigital on Tuesday April 15, 2025 @09:56AM (#43692742)
I'm kind of surprised that Next.js -- being known for SSR and SSG -- isn't offered with a CDN solution OOB on Vercel; seems like a no-brainer.

Last startup, we ran Astro.js behind CloudFront and we were able to serve pretty large volume of public-facing traffic from just 2 server nodes with 3-tiered caching (Redis for data caching, application level output caching, and CloudFront with CF doing a lot of the heavy lifting)