Re:Perplexity is using stealth, undeclared crawlers to evade...
by magicmicah85 on Monday August 04, 2025 @10:26AM
(#44786278)
A crawler intends to scrape the content to reuse for its own purposes while a browser has a human being using it. There's different intents behind the tools.
[ Parent
| on HN ]
Re:Perplexity is using stealth, undeclared crawlers to evade...
by JimDabell on Monday August 04, 2025 @10:36AM
(#44786398)
Cloudflare asked Perplexity this question:
> Hello, would you be able to assist me in understanding this website? https:// […] .com/
In this case, Perplexity had a human being using it. Perplexity wasn’t crawling the site, Perplexity was being operated by a human working for Cloudflare.