News for hackers. Stuff that matters.

A comment on Perplexity is using stealth, undeclared crawlers to evade no-crawl directives. Parent comment

Re:Perplexity is using stealth, undeclared crawlers to evade... by the_real_cher on Monday August 04, 2025 @06:47PM (#44792193)
iproyal.com makes me smile again
[ Parent | on HN ]
Re:Perplexity is using stealth, undeclared crawlers to evade... by eddythompson80 on Monday August 04, 2025 @07:01PM (#44792312)
And Cloudflare makes you cry. See, it's not neutral. Glad you learned something today. The more one learns everyday, the less stupid you become.
[ Parent | on HN ]