Re:Perplexity is using stealth, undeclared crawlers to evade...
by bbqfog on Monday August 04, 2025 @10:15AM
(#44786086)
Correct, it’s user hostile to dictate which software is allowed to see content.
[ Parent
| on HN ]
Re:Perplexity is using stealth, undeclared crawlers to evade...
by klabb3 on Monday August 04, 2025 @11:11AM
(#44786948)
They all do it. Facebook, Reddit, Twitter, Instagram. Because it interferes with their business model. It was already bad, but now the conflict between business and the open web is reaching unprecedented levels, especially since the copyright was scrapped for AI companies.