News for hackers. Stuff that matters.

A comment on Perplexity is using stealth, undeclared crawlers to evade no-crawl directives. Parent comment

Re:Perplexity is using stealth, undeclared crawlers to evade... by dawnerd on Monday August 04, 2025 @11:48AM (#44787502)
Nothing wrong if they fetch on your behalf. The problem is when they endlessly crawl along with every other ai company doing the same.
[ Parent | on HN ]

There are no comments on this comment yet.