News for hackers. Stuff that matters.
Re:Claude can now search the web by SoftTalker on Thursday March 20, 2025 @01:49PM (#43426478)
Maybe we need a new "ai.txt" that says "yes I mean you, ChatGPT et. al."
Re:Claude can now search the web by verdverm on Thursday March 20, 2025 @03:14PM (#43427654)
Bluesky / ATProto has a proposal for User Intents for data. More semantics than robots.txt, but equally unenforceable. Usage with AI is one of the intents to be signaled by users

https://github.com/bluesky-social/proposals/tree/main/0008-u...

Re:Claude can now search the web by JadoJodo on Thursday March 20, 2025 @02:14PM (#43426849)
Re:Claude can now search the web by jsheard on Thursday March 20, 2025 @02:14PM (#43426848)
If they don't comply with robots.txt, why would they comply with anything else?
Re:Claude can now search the web by whoami_nr on Friday March 21, 2025 @11:14AM (#43436677)
Small difference. Its called llms.txt

https://llmstxt.org/