News for hackers. Stuff that matters.

A comment on Perplexity is using stealth, undeclared crawlers to evade no-crawl directives. Parent comment

Re:Perplexity is using stealth, undeclared crawlers to evade... by nradov on Monday August 04, 2025 @10:22AM (#44786207)
Yes, I agree with that. If a website owner expects compensation then they should use a paywall.
[ Parent | on HN ]

There are no comments on this comment yet.