Re:Perplexity is using stealth, undeclared crawlers to evade...
by throwanem on Monday August 04, 2025 @12:06PM
(#44787769)
The HTTP spec draws such a distinction, albeit implicitly, in the form (and name) of its concept of "user agent."
[ Parent
| on HN ]
Re:Perplexity is using stealth, undeclared crawlers to evade...
by alexey-salmin on Monday August 04, 2025 @03:33PM
(#44790445)
Over time it degraded into declaring compatibility with a bunch of different browser engines and doesn't reflect the actual agent anymore.
And very likely Perplexity is in fact using a Chrome-compatible engine to render the page.
Re:Perplexity is using stealth, undeclared crawlers to evade...
by throwanem on Monday August 04, 2025 @03:37PM
(#44790488)
The header to which you refer was named for the concept.
Re:Perplexity is using stealth, undeclared crawlers to evade...
by Tokumei-no-hito on Monday August 04, 2025 @10:19PM
(#44793662)
user agent = which bullshit css hacks and js polyfills will be needed