Scraping websites containing source code which is distributed with specific licenses that OpenAI & co don't follow.
One can train a model exclusively on source code from the linux kernel (GPL) and then generate a bunch of C programs or libraries from that. And they could publish them under MIT license as long as they don't reproduce any identifiable sections from the linux kernel. It does not matter where the model learned how to program.
If I write code with a license that says that using this code for AI training is forbidden then OpenAI is directly going against this by scraping websites indiscriminately.
There is a reason why it is generally advised to go with the established licenses and not invent your own, similarly to how you should not roll your own cryptography: Because it most likely won't work as intended.
e.g. License: This comment is licensed under my custom L*a license. Any user with an username starting with "L" and ending in "a" is forbidden from reading my comment and producing replies based on what I have written.
... see?
Sorry, but the onus is on OpenAI to read the licenses not the creator.
And throwing your hands in the air and saying "oh you can't do that in a license" is also of little use.
A license (copyright law) is not a contract (contract law). Simply publishing something does not make the whole world enter into a contract with you. Others first have to explicitly agree to do so.
> Sorry, but the onus is on OpenAI to read the licenses not the creator.
They can ignore it because they never agreed to it in the first place.
> And throwing your hands in the air and saying "oh you can't do that in a license" is also of little use.
It is very useful to know what works and what does not. That way you don't trick yourself and your work to be safe, don't get caught by surprise if you are in fact not and can think of alternatives instead.
BTW, a thing you can do (which CaptainFever mentioned) and lots of services do because licenses are so weak is to make people sign up with an account and have them enter a ToS agreement instead.
They did by accessing and copying the code. Same as a human cloning a repository and using it's content or someone accessing a website with Terms of Use.
No signed contract is needed here.
By default, copying is disallowed because of copyright. Your license provides them a right to copy the code, perhaps within certain restrictions.
However, sometimes copying is allowed, such as fair use (I covered this in another comment I sent you). This would allow them to copy the code regardless of the license.
> Same as a human cloning a repository and using it's content or someone accessing a website with Terms of Use.
I've covered the cloning/copying part already, but "I agree to this ToS by continuing to browse this webpage" is called a clickwrap agreement. Its enforceability is dubious. I think the LinkedIn case showed that it only applied if HiQ actually explicitly agreed to it by signing up.
Now if the likes of Openai and Google keep the model weights private and just provide generated text, they can try to filter for derivative works, but I don't see a solution that doesn't leak. If a model can be coaxed into producing a derivative work that escapes the filter, then boom, unlicensed copy was provided. If I tell the model to mix two texts word by word, what filter could catch this? What if I tell the model to use a numerical encoding scheme? Or to translate into another language? For example assuming the model knows a bunch of NYT articles by heart, as was already demonstrated: If have it translate one of those articles to French for me, that's still an unlicensed copy!
I can see how they will try to get these violations legalized like the DMCA safe-harbored things, but at the moment they are the ones generating the unlicensed versions and publishing them when prompted to do so.
> People crying for copyright in the context of AI training don't understand what copyright is, how it works and when it applies.
People are complaining about what's happening, not with the exact wording of the law.
What they are doing probably isn't illegal, but it _should_ be. The problem is that it's very difficult for people to pass new legislation because they don't have lobbyists the way corporations do.
The things that constitute potentially infringing copying are not clearly well-defined, and whether or not training an AI is on that list has of course not yet been considered by a court. But you can make cogent arguments either way, and I would not be prepared to bet on either outcome. Keep in mind also that, legally, copying data from disk to RAM is considered potentially infringing, which should give you a sense of the sort of banana-pants setup that copyright can entail.
That said, if training is potentially infringing on copyright, it now seems pretty clear that a fair use defense is going to fail. The recent Warhol decision rather destroys any hope that it might be considered "transformative", while the fact that the AI companies are now licensing content for training use is a concession that the fourth and usually most important factor (market impact) weighs against fair use.
But you are right, we don't know until president is set by a court. I am only warning people that laying back and hoping that copyright will apply as they wish is not a good strategy to defend your work. One should consider alternative legal constructs or simply not releasing material to the general public anymore.
People crying for copyright in the context of AI training don't understand what copyright is, how it works and when it applies.
What they think how copyright works: When you take someones work as inspiration then everything you produce form that counts as derivative work.
How copyright actually works: The input is irrelevant, only the output matters. Thus derivative work is what explicitly contains or resembles underlying work, no matter if it was actually based on that or it is just happenstance / coincidence.
Thus AI models are safe from copyright lawsuits as long as they filter out any output which comes too close to known material. Everything else is fine, even if the model was explicitly trained on commercial copyrighted material only.
In other words: The concept of intellectual property is completely broken and that is old news.