News for hackers. Stuff that matters.

A comment on The Cost of Being Crawled: LLM Bots and Vercel Image API Pricing. Parent comment

Re:The Cost of Being Crawled: LLM Bots and Vercel Image API ... by randunel on Tuesday April 15, 2025 @03:33AM (#43689993)
Do you or do you not visit and respect "robots.txt" on the hosts you've mentioned in your blog post as downloading via next.js?
[ Parent | on HN ]

There are no comments on this comment yet.