Re:Perplexity is using stealth, undeclared crawlers to evade...
by otterley on Monday August 04, 2025 @11:29AM
(#44787206)
Why would a personal browser have to crawl fewer pages than the agent’s mechanism? If anything, the agent would be more efficient because it could cache the content for others to use. In the situation we’re talking about, the AI engine is behaving essentially like a caching proxy—just like a CDN.
[ Parent
| on HN ]
There are no comments on this comment yet.