Re:We should start to add “ai.txt” as we do for “robots.txt”
by kmoser on Wednesday May 10, 2023 @11:57AM
(#35889221)
Not only do we already have lots of ways of including structured metadata, but if you want to include directives about what should/shouldn't be scraped and by whom, we already have robots.txt.
In other words, there's no need to create an ai.txt when the robots.txt standard can just be extended.
In other words, there's no need to create an ai.txt when the robots.txt standard can just be extended.