News for hackers. Stuff that matters.
Re:llms.txt directory by Diti on Tuesday December 24, 2024 @08:31AM (#42501777)
If one doesn’t want LLMs to scrape data and knows the LLMs will be ignoring the robots.txt file.

There are no comments on this comment yet.