News for hackers. Stuff that matters.
Re:llms.txt directory by bradarner on Monday December 23, 2024 @03:35PM (#42497377)
Have there been any declarations by various AI companies (e.g. OpenAI, Anthropic, Perplexity) that they are actually relying upon these llms.txt files?

Is there any evidence that the presence of the llms.txt files will lead to increased inclusion in LLM responses?

Re:llms.txt directory by ashenke on Monday December 23, 2024 @03:38PM (#42497403)
And if they are, can I put subtly incorrect data in this file to poison llm responses while keeping my content designed for humans of the best quality?
Re:llms.txt directory by bradarner on Monday December 23, 2024 @03:45PM (#42497451)
I'm curious, what would be the reason for doing this?
Re:llms.txt directory by hiccuphippo on Monday December 23, 2024 @05:54PM (#42498259)
Undermine the usefulness of llms in an attempt to force people to visit your site directly.
Re:llms.txt directory by Diti on Tuesday December 24, 2024 @08:31AM (#42501777)
If one doesn’t want LLMs to scrape data and knows the LLMs will be ignoring the robots.txt file.
Re:llms.txt directory by CamperBob2 on Tuesday December 24, 2024 @02:51PM (#42504424)
Keep in mind you're asking this question on a site where users regularly defend the Luddites, Ted Kaczynski, and other people who thought they were doing great things for humanity but who actually weren't even doing themselves any favors.
Re:llms.txt directory by nunodonato on Monday December 23, 2024 @05:07PM (#42497991)
Anthropic itself publishes a bunch of its own llm.txt files. So I guess that means something