News for hackers. Stuff that matters.
Re:Perplexity is using stealth, undeclared crawlers to evade... by donkeybeer on Tuesday August 05, 2025 @08:18AM (#44797124)
I don't see the problem. I want AI agents to learn my website and have it available as part of its corpus of knowledge to users. If asked for something it can answer the question, and if user requests make a parallel web search for sources which would bring up my page. The latter is only a bonus not a necessity for me. Getting the information out there by whatever means is my first priority.

There are no comments on this comment yet.