News for hackers. Stuff that matters.

A comment on Perplexity is using stealth, undeclared crawlers to evade no-crawl directives. Parent comment

Re:Perplexity is using stealth, undeclared crawlers to evade... by cma on Monday August 04, 2025 @04:30PM (#44791003)
These are more like a store putting up a billboard or catalog and asking people to turn off their meta AI glasses nearby because the store doesn't want AI translating it on your behalf as a tourist.
[ Parent | on HN ]
Re:Perplexity is using stealth, undeclared crawlers to evade... by itsdesmond on Monday August 04, 2025 @06:55PM (#44792263)
It is not because the store does not expend any resources on the singular instance of the glasses capturing the content of the billboard. Web requests cost money.
[ Parent | on HN ]