We should start to add “ai.txt” as we do for “robots.txt”

Re:We should start to add “ai.txt” as we do for “robots.txt” by TechBro8615 on Wednesday May 10, 2023 @10:36AM (#35888011)

If AI is using training data from your site, presumably it got that data by crawling it. So either it's already respecting robots.txt, in which case ai.txt would be redundant, or it's ignoring it, in which case there's no reason to expect it would respect ai.txt any more than it did robots.txt.

[ Parent | on HN ]

Re:We should start to add “ai.txt” as we do for “robots.txt” by zerotolerance on Wednesday May 10, 2023 @10:55AM (#35888298)

robots.txt is about crawling, ai.txt would assumably be either augmentative metadata or specific copyright terms of use with respect to AI uses.

[ Parent | on HN ]

Re:We should start to add “ai.txt” as we do for “robots.txt” by LawTalkingGuy on Wednesday May 10, 2023 @12:20PM (#35889562)

> specific copyright terms of use

There's no such thing. Without a license you can't enforce any restrictions.

AI training is basically just building a very complex Markov chain, that's obviously not copyright violation because the output product doesn't contain the input - only data about it. If your text has been copied then please point to it in these weights here.

[ Parent | on HN ]

Re:We should start to add “ai.txt” as we do for “robots.txt” by throwaway290 on Wednesday May 10, 2023 @01:40PM (#35890696)

The output product is an automatically created (no sweat of the brow) derivative work, copyright very much applies especially if derivative work is generated for sale (like in case of openai).

[ Parent | on HN ]

Re:We should start to add “ai.txt” as we do for “robots.txt” by efreak on Friday May 12, 2023 @06:33PM (#35923369)

> especially since the tool is used to generate derivative works for profit (like in case of openai/microsoft).

Profit/nonprofit is irrelevant to copyright.

[ Parent | on HN ]

Re:We should start to add “ai.txt” as we do for “robots.txt” by throwaway290 on Sunday May 14, 2023 @01:05PM (#35939411)

Where (and more importantly how) do you live that you don't have fair use exception?

[ Parent | on HN ]

Re:We should start to add “ai.txt” as we do for “robots.txt” by asdkjlfkasjdf on Wednesday May 10, 2023 @07:33PM (#35895061)

exactly, but nobody in their sane minds would be using robots.txt to block crawlers as that is SEO (organic traffic from searches) disaster.

People could be adding a specific robot user-agent, if they knew openai even existed before yesterday and was stealing their content. but nobody did.

[ Parent | on HN ]