News for hackers. Stuff that matters.
Re:Perplexity is using stealth, undeclared crawlers to evade... by gunalx on Monday August 04, 2025 @03:41PM (#44790525)
It is in the name, rules for the robots. Any scraping ai or not, and even mass recrsive or single page, should abide by the rules.

There are no comments on this comment yet.