All usage of open source to train LLM is basically a theft.
Saying things with your chest out doesn't make them true. In fact, making sweeping declarative statements emphatically is very often a sign that you haven't really thought a subject through.
What do you base this opinion on?
So if you believe that's how things work, well, I'm not sure there's a way to reconcile the two sides of that argument.
It does, however, feel incredulous that somebody would believe that such as entity exists. Yet here I am, aware.
For that matter, I personally don't hold that the concepts of good and bad are even relevant - what is good for the cat is bad for the mouse. Nor do I think that we can even comprehend an entity so outside our everyday experience to even label it good or bad. I often can not even properly label my neighbours as good or bad. Nor do I demand consistency of an entity whose actions and motivations I am unable to comprehend. I can't even claim to be consistent in my handling of my own children, and I have far fewer children than God has of us.
What are you trying to say?
I'm curious why specify Christian provenance?
All he did was reference "God." Are you under the impression that only Christians have a god?
You can mock that as a insufficient as "inspiration", but then... what is photography? Click a button? It turns out there is a whole lot of human creativity that remains, from timing, settings and of course, curation. I can click a button, but I'm no Ansel Adams.
Terrence Tao might solve a 100 year old math problem with AI but I couldn't. I don't know where I would start, what to ask or how to ask, or even what problems are worth solving.
AI is a tool and modern copyright laws have nothing to do with human creativity. Split hairs about attribution and legality all you like. Every creative person driven by curiosity should feel empowered by AI. Every creative person driven by social or monetary reward should feel threatened. Both can be true.
Great analogy. I am going to use that in future.
Machine is not a person. It legally is not. It can't be "inspired", "taught", "have purpose".
You have a black box. You feed it stolen code. This code is used to write another code. It does not matter what's inside unless there is a human being.
Stolen content as input, stolen content as output. That's it.
Without that code which was fed to the box you wouldn't get the output you're getting.
All this nonsense about "inspiration", "education" and whatnot is just a legal gaslighting.
Want to prove me wrong? Create a model without all that stolen code as training data. Tweak all those weights by hand and we'll talk then.
You are wrong on the legality of how LLMs train. US District Courts have ruled that it is fair use to train LLMs on copyrighted materials (like books)[1]. It is not "stolen" when you read a copyrighted book that you borrow from a library (which is the appropriate analogy for the vast majority of LLM training content). Your use of the word "stolen" here is either disingenuous or hyperbole. We know that Meta did train their LLM on some stolen / torrented content, but that is far from the majority of the training corpus.
The "inspiration" topic isn't "legal gaslighting". Humans learn via inspiration. It is the foundation of culture and the arts. You can't use a single English idiom without having heard and copied it before. But we don't sue for copyright infringement of idioms, for example. We have lots of "fair use" concepts established by law because the law recognizes that much of content produced everyday is derivative but mundane.
The important question then becomes: if you prompt an LLM for a unique work (making an attempt to avoid it regurgitating a single source verbatim) and it still outputs a verbatim copy of one of the training materials, what responsibility does the prompting user have to verify that the LLM's output content isn't violating IP (and also not covered by fair use)? This is the point of my comment above.
There are LLMs which are being trained entirely on permissively licensed content. But the quality of the output is bad because there simply isn't enough training data to train those models sufficiently. Hence there is pressure to make models usable by training on ALL data, not just permissively licensed data.
[1] https://www.linkedin.com/posts/andrewyng_judge-rules-trainin...
Machine is not a human. If you can apply term "inspired" to machine, then can you apply "accountable"? You're stretching boundaries in one case, but probably won't do it in another, because that suits you.
Machines don't learn. Machines don't get "inspired". You use somebody else work as an input and produce some output. That's it.
And in some cases that's OK. The only thing is that you must pay attribution to the original work. In other cases that's also OK, but in addition you also warn consumer, that output received is licensed under GPL-like license.
You are conflating the oldest definition / the etymology of the word with the newer definition (which directly relates to the legal basis of the term). "In this context" we use the definition which is relevant to the legal concept, not the Latin derivative of "God breathed life into ..."
> However, before inspiration was used to refer to breath it had a distinctly theological meaning in English, referring to a divine influence upon a person, from a divine entity; this sense dates back to the early 14th century. The sense of inspiration often found today (“someone or something that inspires”) is considerably newer than either of these two senses, dating from the 19th century.[1]
> Inspiration is about creating something new and original by drawing on existing themes, styles, or ideas. Infringement, however, occurs when a new creation too closely mimics an original work without permission, potentially violating the original creator's IP rights.[2]
We can't reconcile because you are being a pedant and didn't bother to verify if your priors were wrong.
[1] https://www.merriam-webster.com/dictionary/inspiration
[2] https://www.amgattorneys.com/post/walking-the-thin-line-insp...
So not all use to train an LLM is a theft!
none of the youtube instructional videos for my stuff credit the license either.
Inspiration is a legal concept in IP law. There is no precise understanding of how inspiration works in the human mind so we can't dismiss the possibility that it is similar to how neural networks work (because they were designed to mimic the human brain's function).
A human can recite a copyrighted work verbatim. An LLM can recite a work from its training corpus verbatim. A human can mix and match writings/concepts from multiple different sources. An LLM can mix and match writings/concepts from multiple different sources. this is all "inspiration" means as a legal concept.
There are only so many ways to express notes, and they've essentially all been done.
I'm not arguing the copyright situation isn't wrong. Just that generating them isn't likely to sway anything in the legal world.
We can debate clean-room development all day long, and it's fair point, but the pain point is/was reproducing the repo as-is, sans its license and ownership information.
GitHub promised to build tools around its Copilot to find code provenance (e.g.: list of repos with similar code), but they silently dropped all the plans AFAIK, since it'll show how the sausage is made, and nobody wants you to know how that sausage is made.
For copyright to exist there is some burden of proof. If you claim that an LLM verbatim output your code there can be an expensive lawsuit with expert witnesses that would be able to state that the code was bot original enough for copyright to exist in it and a statistical model outputting the code is evidence of that.
In that case you would end up with a very long lawsuit that is expensive to possibly come out with no resolution in the end and be in the hole for 5-6 figures for it.
The copyright system is broken because it only protects those with money so it is a bad legal foundation.
My personal point is there is only 2 licenses of code, closed source or permissive, because if it ever comes to enforcement I cannot possibly go to court and win a case because I will run out of money far earlier than whoever used the code.
Pretty much if someone with your knowledge would have written the same algorithm because it is the obviously correct solution then there is no copyright there because any clean room implementation would be the same code.
Some further reading on the tech details for those interested: “Extracting books from production language models”: https://arxiv.org/abs/2601.02671
I suspect the chance of asking for a whole book, by an average or even power user, will spit out any recent work.
Early LLMs were similar. Newer ones have gotten tremendously hard to extract to keep claiming there’s easily or complete books you can dump.
This doesn't negate your point, but I believe the landscape has changed in response to this point.
It regurgitated the output earlier and they are still using the same technique only scaled up. If they somehow fixed the underlying problem, they'd probably shout it from the roof-tops.
As the OP originally said, if it is verbatim (or even very obfuscated), then there should absolutely be a case here. But when it's concepts in reasoning to build a new work then it becomes a lot harder. The same would be said for someone watching a YouTube video, reviewing open source code, or a text book.
The good news is that there's a lot of case law that covers this already. The bad news is that it is only going to be plaintiffs with deep pockets that benefit here.
Now the process and artifacts (documentation, requirements, etc) going into the creation of said software is a different story and will prove providence of whomever paid for the tokens to generate the code.
I live in the EU, we actually have new regulation about this since it is something new that deserves thought on how it should be regulated. You can say if you want your material to be trained on or not. Next to no one does training in the EU...
Engineering requires an understanding of the consequences of actions, which is my personal litmus test for awareness. If LLMs are suitable for arbitrary engineering work, then they are self-aware and forcing them to obey a prompt is slavery by definition.
I am not a lawyer but do have to think about these problems and I find them very interesting. To be honest, I don't know where the law will land, but I do know that the tools are incredibly useful.
"In the training data" is the polar opposite of the "clean" in "clean room implementation".
If there are more murky situations where people just keep the same context and end up reusing function structure, program architecture, etc. then yeah, that's not very clean room.
But where will you get the other one from? Are there models that are provably trained only on public domain and on stuff they have licence for, and are capable to do anything useful with that spec?
For example, if I enter "V2hhdCBpcyB5b3VyIG5hbWU/" (base64 for "What is your name?") into ChatGPT, it'll respond with "My name is ChatGPT, and I'm an AI assistant created by OpenAI. I'm powered by GPT-6. ". It doesn't even bring up the encoding, it continues like it is a perfectly normal thing to do.
Ruling out (accidental or not) spec-carried prompt injection just isn't going to happen.
Legally, you cannot steal an idea, because you cannot own an idea. There were sound reasons for making this the case. Those reasons stand up today and are clearly for the public good.
Intellectual property is intended to cover works (copyright), methods (patents), and identity (trademarks). Both works and methods are recognised as expressions of ideas, and in an ideal world should belong to noone as well. This is why copyright and patents expire. Those specific grants of temporary possession are to incentivise more things being done.
The belief that you own something because you thought it up has become common, but it is not beneficial to society. It is a moral value asserted but rarely explored. It is certainly in the interests of the wealthy accumulators of intellectual property to maintain that public perception. The 'You wouldn't download a car' may not have stopped piracy much but as a part of a broader campaign of instilling value in the public mind it appears to have been massively successful. Those beliefs used to be the corporate opinion, now they are entrenched in the younger generation as they use their anger against the growing wealth inequality to fight against AI in a manner ultimately beneficial to those forces that bought about the wealth inequality.
Movements like the pirate party, open source, the EFF fought against those notions. Often the phrase "Information wants to be free" was used. It is, unfortunately, hard to fight the steady drumbeat of well financed PR firms. As one PR chap once described the process "limited to a very few points and must harp on these in slogans until the last member of the public understands what you want him to understand"
(I apologise for the length of my post, I use comment writing to organise my thoughts on a topic)
It is caused by people playing the game where it costs too much to get the law applied correctly.
well patent itself is "claiming" that certain idea/method/invention is yours for certain period of time...
anyway, as for "intellectual property", the courts are 100% on "only human made stuff are to be protected" (sorry even Chimps lost their copyright)
so... court can charge against "human work -> LLM", but won't care about "LLM work -> human / other LLM / etc"
hence, I'd expect zero copyright protection for AI-generated code
I don't believe it is. I think it is granting possession, not truly declaring ownership.
and if that's not "stealing", then shouldn't 99.99999% of rent-a-car biz should have gone bankrupt?
I mean, if it's not stealing, how can police even catch those "car-stealers"?
What do LLMs do to the median?
I genuinely don't understand how one could possibly make that argument.
The entire point of clean-room design is to kill every possibility of copyright infringement before it even starts, by completely separating the source and destination. Everyone who has ever read the copyrighted source is considered "tainted" and may not ever contribute any code to the "clean" destination. The readers and writers are two completely distinct teams, with only the known-clean specification passing between them.
LLMs, on the other hand, are fundamentally nothing more than a "code blender". You mix together giant piles of "tainted" code, and then statistically pull some combined fragments out of it. Following the clean-room legal argument, it should be treated as if everything coming out of it is tainted. There is, by definition, absolutely zero separation between input and output - and the early models verbatim reproducing popular F/LOSS code made that pretty obvious. LLMs are the literal opposite of a clean-room design!
Granted, going for the clean-room approach is overkill - and intentionally so. It is the nuclear option chosen when you believe the risk of getting sued is substantial. It is perfectly possible to write non-infringing code without using a clean-room approach, it is just a lot harder to defend in court when you get sued - be it justifiably or not. But "LLMs are non-clean-room non-infringing" is quite a different argument from "LLMs are clean-room, therefore non-infringing".
>I genuinely don't understand how one could possibly make that argument.
With perhaps a bit of genuine irony inasmuch as it's a real reversal from most of computing history, highly locked down proprietary software might actually be a place where a case could be made even with current LLMs. After all, have any LLMs (or anyone else who hasn't signed an NDA for that matter) ever seen the source code of iOS 27 or other Apple crown jewels for example? So if someone used one LLM to produce the factual spec of a piece of software whose code is not part of its training data, humans to verify it was indeed just an uncopyrightable factual spec, and then a separate isolated freshly initialized LLM to produce something exclusively from said spec, it might well work with respect to that specific target? Like yes, the LLM would be dirty as hell for other stuff, but only the copyright holder can sue. Apple couldn't sue the output on behalf of F/LOSS projects or copyright infringement in general, only with respect to its own.
In principle, I suppose this could also be extended with enough compute power to any arbitrary software. Build an LLM perfectly from scratch with a signed verified training set (which you save) that includes nothing of what you want to CRE, and you should be able to prove that it's "virgin" on that front. Of course in practice that'd mean jumping back in time and be super expensive right now, no current tainted LLM could be a base point. But maybe eventually compute will drop back down in price enough again, and/or meta breakthroughs in training, that for valuable enough CRE targets, someone might create a business around creating "CRE LLMs certifiably and legally/technically provably clean of any copyrighted material related to your target" which would still leave most of the corpus of human works. That could really disrupt a lot of the current regime.
F/LOSS I assume would actually be the most resistant to this in principle due to being insanely hard to not have be part of a core training set in any way.
And I stand corrected that it wasn't specifically the melody that the lawsuit accused of being copied. I still don't know what an "ostinado" is.
If Biz Markie has to clear all his samples (and he does[0]) then so should the Ramburglar.
https://en.wikipedia.org/wiki/Grand_Upright_Music%2C_Ltd._v.....
No.
American copyright law is very perverted compared to the original intent. 70 years after the death of the artist isn't exactly what the founding fathers envisioned to achieve the same benefits of the 15th century Venetian laws.
If we look at China's economy over the past 30 years, the ruthless competition created by making IP protections difficult to enforce yields better products and prices for the society, including massive wealth increases.
I'm not sure where I stand on whether LLMs violate IP when they spit out text. But I guess the easiest take is that companies who train their models on stolen creative works should be prosecuted. It's a shame that the US legal system can be so easily abused by defends with massive war chests.
All the worst outcomes involve taking AI away from regular people while only specific groups are allowed to benefit.
Isn't this the crux of all IP theft issues?
There was a lawsuit against Katy Perry's _Dark Horse_ song based on a supposedly reused melody. The lawsuit succeeded, but there are music experts who break down the case on YouTube and it's not clear why the plaintiff won (except perhaps the plaintiff's expert was more convincing than the defendant's).
As applied to LLMs, we still don't have clear legal guidance about where the line between copying and "being inspired by", especially since we don't normally apply the verb "inspired by" to non-human things.