News for hackers. Stuff that matters.

A comment on Perplexity is using stealth, undeclared crawlers to evade no-crawl directives. Parent comment

Re:Perplexity is using stealth, undeclared crawlers to evade... by noboostforyou on Wednesday August 06, 2025 @03:59PM (#44816949)
> You’re not obliged to participate in discussion.

Are website owners obligated to serve content to AI agents and/or LLM scrapers?

[ Parent | on HN ]

There are no comments on this comment yet.