News for hackers. Stuff that matters.

A comment on Perplexity is using stealth, undeclared crawlers to evade no-crawl directives. Parent comment

Re:Perplexity is using stealth, undeclared crawlers to evade... by mnmalst on Monday August 04, 2025 @10:18AM (#44786138)
But that's not what this article is about. From, what I understand, this articles is about a user requesting information about a specific domain and not general scraping.
[ Parent | on HN ]

There are no comments on this comment yet.