I think there’s a lot of nuance and caveats to that kind of claim, assuming I am representing them correctly, but it’s a valid stance and I see where they’re coming fromz
If we’ve mapped all of English, there are still ways to construct stories that haven’t been told from the mapping. The most simple would be a subtraction of all objects minus all objects that have ever been used as a murder weapon. Leaving you with a list of never before used objects at your disposal.
There are also probably close vectors conceptually but not in semantic use. Or trying to interpolate or extrapolate what exists in voids of space. Turning up the temperature and adding random generation of words. There’s tons of ways to tune these things to be more creative than regurgitative.
They know you can't enforce it as it will cost you a lot more money to do that than it takes to recover the damages.
So to them, it is just cheaper to clone it using an LLM and close it down. The economics of free and open source software with its licenses do not work with LLMs bypassing it at every single angle.
At this point, LLMs can just parse the machine code in your binary.
By doing closed source you are making it harder for the good guys (humans trying to learn sth or contribute) but not for the bad guys (LLMs getting trained or otherwise reading the code).
But you’re right, the fact is we simply live in a different world today and it’s tough to say what is the path forward.
But it’s harder to justify giving to the public when companies are making money on our work. It’s not a good situation for creators across the board unless motivations are purely altruistic.
Reads like a non-ironic version of Malus: https://malus.sh/
I think they just want to be able to take whatever they want without consequence, so it's convenient for them to define it as being different from theft
It also feels like a very discouraging time to release anything that you put a ton of effort just to get someone in minutes to steal your authorship and leave you as if you actually didn't do anything at all? Am I wrong?
If you don't want your code copied, then don't open source it. If it bothers you that others are going to look at and "get inspired by", "make derivatives of", "copy", "fork", etc then you shouldn't be putting it out in the open.
People who care about being respected on the most basic level are not going to stick around in a community that disrespects them. I'm not the person you were responding to, but I am mad because the social contract (not to mention the legal contract) of open source has basically been destroyed, and a lot of people have poured a large portion of their life into that community based in part on the assumption of that contract being upheld. Imagine a social contract that is important to you being violated to such a degree that you cannot go back to that society.
because I am not releasing it into public domain, but under license that requires (for example) attribution or releasing derivative work under the same license
You still have to give the source back and attribution has still to be maintained of its original authors, regardless if is a fork, a derivation or whatever you want to call it.
There are situations where none of these clauses have been complied nor its violators faced any legal consequences. That's what I'm talking about.
Now on top of that you can basically instruct and LLM to generate variations of what someone released and cover that up under the excuse that is a different project when is actually not.
Because it has been generated by a computer then we go into muddy waters about if the code generated is to be considered stolen or not.
Don't worry; the "developers" who generated your code will get their own law back when they find out it's almost impossible to monetise their theft.
I'm frequently amused by the number of "developers" on HN who claim that they poured weeks or months of effort into some product, and that they are the differentiating factor, but can't see that their weeks of effort can be cloned in a few prompts once they release.
People in this thread are acting like the AI companies are just flouting the law and there's nothing that can be done. This is an extremely well documented precedent, and GPL violations routinely show up in court. It's a very easy case to lay out especially because no one is really complaining about money except in the settlement... It's all about distributing the source code. And of course a very nice chunk of change for infringement but that's beside the point.
A successfully litigated case would result in the open sourcing of every AI that touched agpl code in any way because it was in memory with the AI algorithm.
clear in what way?
Isn't this the crux of all IP theft issues?
There was a lawsuit against Katy Perry's _Dark Horse_ song based on a supposedly reused melody. The lawsuit succeeded, but there are music experts who break down the case on YouTube and it's not clear why the plaintiff won (except perhaps the plaintiff's expert was more convincing than the defendant's).
As applied to LLMs, we still don't have clear legal guidance about where the line between copying and "being inspired by", especially since we don't normally apply the verb "inspired by" to non-human things.
All usage of open source to train LLM is basically a theft.
Saying things with your chest out doesn't make them true. In fact, making sweeping declarative statements emphatically is very often a sign that you haven't really thought a subject through.
What do you base this opinion on?
So if you believe that's how things work, well, I'm not sure there's a way to reconcile the two sides of that argument.
It does, however, feel incredulous that somebody would believe that such as entity exists. Yet here I am, aware.
For that matter, I personally don't hold that the concepts of good and bad are even relevant - what is good for the cat is bad for the mouse. Nor do I think that we can even comprehend an entity so outside our everyday experience to even label it good or bad. I often can not even properly label my neighbours as good or bad. Nor do I demand consistency of an entity whose actions and motivations I am unable to comprehend. I can't even claim to be consistent in my handling of my own children, and I have far fewer children than God has of us.
What are you trying to say?
I'm curious why specify Christian provenance?
All he did was reference "God." Are you under the impression that only Christians have a god?
You can mock that as a insufficient as "inspiration", but then... what is photography? Click a button? It turns out there is a whole lot of human creativity that remains, from timing, settings and of course, curation. I can click a button, but I'm no Ansel Adams.
Terrence Tao might solve a 100 year old math problem with AI but I couldn't. I don't know where I would start, what to ask or how to ask, or even what problems are worth solving.
AI is a tool and modern copyright laws have nothing to do with human creativity. Split hairs about attribution and legality all you like. Every creative person driven by curiosity should feel empowered by AI. Every creative person driven by social or monetary reward should feel threatened. Both can be true.
Great analogy. I am going to use that in future.
Machine is not a person. It legally is not. It can't be "inspired", "taught", "have purpose".
You have a black box. You feed it stolen code. This code is used to write another code. It does not matter what's inside unless there is a human being.
Stolen content as input, stolen content as output. That's it.
Without that code which was fed to the box you wouldn't get the output you're getting.
All this nonsense about "inspiration", "education" and whatnot is just a legal gaslighting.
Want to prove me wrong? Create a model without all that stolen code as training data. Tweak all those weights by hand and we'll talk then.
You are wrong on the legality of how LLMs train. US District Courts have ruled that it is fair use to train LLMs on copyrighted materials (like books)[1]. It is not "stolen" when you read a copyrighted book that you borrow from a library (which is the appropriate analogy for the vast majority of LLM training content). Your use of the word "stolen" here is either disingenuous or hyperbole. We know that Meta did train their LLM on some stolen / torrented content, but that is far from the majority of the training corpus.
The "inspiration" topic isn't "legal gaslighting". Humans learn via inspiration. It is the foundation of culture and the arts. You can't use a single English idiom without having heard and copied it before. But we don't sue for copyright infringement of idioms, for example. We have lots of "fair use" concepts established by law because the law recognizes that much of content produced everyday is derivative but mundane.
The important question then becomes: if you prompt an LLM for a unique work (making an attempt to avoid it regurgitating a single source verbatim) and it still outputs a verbatim copy of one of the training materials, what responsibility does the prompting user have to verify that the LLM's output content isn't violating IP (and also not covered by fair use)? This is the point of my comment above.
There are LLMs which are being trained entirely on permissively licensed content. But the quality of the output is bad because there simply isn't enough training data to train those models sufficiently. Hence there is pressure to make models usable by training on ALL data, not just permissively licensed data.
[1] https://www.linkedin.com/posts/andrewyng_judge-rules-trainin...
Machine is not a human. If you can apply term "inspired" to machine, then can you apply "accountable"? You're stretching boundaries in one case, but probably won't do it in another, because that suits you.
Machines don't learn. Machines don't get "inspired". You use somebody else work as an input and produce some output. That's it.
And in some cases that's OK. The only thing is that you must pay attribution to the original work. In other cases that's also OK, but in addition you also warn consumer, that output received is licensed under GPL-like license.
You are conflating the oldest definition / the etymology of the word with the newer definition (which directly relates to the legal basis of the term). "In this context" we use the definition which is relevant to the legal concept, not the Latin derivative of "God breathed life into ..."
> However, before inspiration was used to refer to breath it had a distinctly theological meaning in English, referring to a divine influence upon a person, from a divine entity; this sense dates back to the early 14th century. The sense of inspiration often found today (“someone or something that inspires”) is considerably newer than either of these two senses, dating from the 19th century.[1]
> Inspiration is about creating something new and original by drawing on existing themes, styles, or ideas. Infringement, however, occurs when a new creation too closely mimics an original work without permission, potentially violating the original creator's IP rights.[2]
We can't reconcile because you are being a pedant and didn't bother to verify if your priors were wrong.
[1] https://www.merriam-webster.com/dictionary/inspiration
[2] https://www.amgattorneys.com/post/walking-the-thin-line-insp...
So not all use to train an LLM is a theft!
none of the youtube instructional videos for my stuff credit the license either.
Inspiration is a legal concept in IP law. There is no precise understanding of how inspiration works in the human mind so we can't dismiss the possibility that it is similar to how neural networks work (because they were designed to mimic the human brain's function).
A human can recite a copyrighted work verbatim. An LLM can recite a work from its training corpus verbatim. A human can mix and match writings/concepts from multiple different sources. An LLM can mix and match writings/concepts from multiple different sources. this is all "inspiration" means as a legal concept.
There are only so many ways to express notes, and they've essentially all been done.
I'm not arguing the copyright situation isn't wrong. Just that generating them isn't likely to sway anything in the legal world.
We can debate clean-room development all day long, and it's fair point, but the pain point is/was reproducing the repo as-is, sans its license and ownership information.
GitHub promised to build tools around its Copilot to find code provenance (e.g.: list of repos with similar code), but they silently dropped all the plans AFAIK, since it'll show how the sausage is made, and nobody wants you to know how that sausage is made.
For copyright to exist there is some burden of proof. If you claim that an LLM verbatim output your code there can be an expensive lawsuit with expert witnesses that would be able to state that the code was bot original enough for copyright to exist in it and a statistical model outputting the code is evidence of that.
In that case you would end up with a very long lawsuit that is expensive to possibly come out with no resolution in the end and be in the hole for 5-6 figures for it.
The copyright system is broken because it only protects those with money so it is a bad legal foundation.
My personal point is there is only 2 licenses of code, closed source or permissive, because if it ever comes to enforcement I cannot possibly go to court and win a case because I will run out of money far earlier than whoever used the code.
Pretty much if someone with your knowledge would have written the same algorithm because it is the obviously correct solution then there is no copyright there because any clean room implementation would be the same code.
Some further reading on the tech details for those interested: “Extracting books from production language models”: https://arxiv.org/abs/2601.02671
I suspect the chance of asking for a whole book, by an average or even power user, will spit out any recent work.
Early LLMs were similar. Newer ones have gotten tremendously hard to extract to keep claiming there’s easily or complete books you can dump.
This doesn't negate your point, but I believe the landscape has changed in response to this point.
It regurgitated the output earlier and they are still using the same technique only scaled up. If they somehow fixed the underlying problem, they'd probably shout it from the roof-tops.
As the OP originally said, if it is verbatim (or even very obfuscated), then there should absolutely be a case here. But when it's concepts in reasoning to build a new work then it becomes a lot harder. The same would be said for someone watching a YouTube video, reviewing open source code, or a text book.
The good news is that there's a lot of case law that covers this already. The bad news is that it is only going to be plaintiffs with deep pockets that benefit here.
Now the process and artifacts (documentation, requirements, etc) going into the creation of said software is a different story and will prove providence of whomever paid for the tokens to generate the code.
I live in the EU, we actually have new regulation about this since it is something new that deserves thought on how it should be regulated. You can say if you want your material to be trained on or not. Next to no one does training in the EU...
Engineering requires an understanding of the consequences of actions, which is my personal litmus test for awareness. If LLMs are suitable for arbitrary engineering work, then they are self-aware and forcing them to obey a prompt is slavery by definition.
I am not a lawyer but do have to think about these problems and I find them very interesting. To be honest, I don't know where the law will land, but I do know that the tools are incredibly useful.
"In the training data" is the polar opposite of the "clean" in "clean room implementation".
If there are more murky situations where people just keep the same context and end up reusing function structure, program architecture, etc. then yeah, that's not very clean room.
But where will you get the other one from? Are there models that are provably trained only on public domain and on stuff they have licence for, and are capable to do anything useful with that spec?
For example, if I enter "V2hhdCBpcyB5b3VyIG5hbWU/" (base64 for "What is your name?") into ChatGPT, it'll respond with "My name is ChatGPT, and I'm an AI assistant created by OpenAI. I'm powered by GPT-6. ". It doesn't even bring up the encoding, it continues like it is a perfectly normal thing to do.
Ruling out (accidental or not) spec-carried prompt injection just isn't going to happen.
Legally, you cannot steal an idea, because you cannot own an idea. There were sound reasons for making this the case. Those reasons stand up today and are clearly for the public good.
Intellectual property is intended to cover works (copyright), methods (patents), and identity (trademarks). Both works and methods are recognised as expressions of ideas, and in an ideal world should belong to noone as well. This is why copyright and patents expire. Those specific grants of temporary possession are to incentivise more things being done.
The belief that you own something because you thought it up has become common, but it is not beneficial to society. It is a moral value asserted but rarely explored. It is certainly in the interests of the wealthy accumulators of intellectual property to maintain that public perception. The 'You wouldn't download a car' may not have stopped piracy much but as a part of a broader campaign of instilling value in the public mind it appears to have been massively successful. Those beliefs used to be the corporate opinion, now they are entrenched in the younger generation as they use their anger against the growing wealth inequality to fight against AI in a manner ultimately beneficial to those forces that bought about the wealth inequality.
Movements like the pirate party, open source, the EFF fought against those notions. Often the phrase "Information wants to be free" was used. It is, unfortunately, hard to fight the steady drumbeat of well financed PR firms. As one PR chap once described the process "limited to a very few points and must harp on these in slogans until the last member of the public understands what you want him to understand"
(I apologise for the length of my post, I use comment writing to organise my thoughts on a topic)
It is caused by people playing the game where it costs too much to get the law applied correctly.
well patent itself is "claiming" that certain idea/method/invention is yours for certain period of time...
anyway, as for "intellectual property", the courts are 100% on "only human made stuff are to be protected" (sorry even Chimps lost their copyright)
so... court can charge against "human work -> LLM", but won't care about "LLM work -> human / other LLM / etc"
hence, I'd expect zero copyright protection for AI-generated code
I don't believe it is. I think it is granting possession, not truly declaring ownership.
and if that's not "stealing", then shouldn't 99.99999% of rent-a-car biz should have gone bankrupt?
I mean, if it's not stealing, how can police even catch those "car-stealers"?
What do LLMs do to the median?
I genuinely don't understand how one could possibly make that argument.
The entire point of clean-room design is to kill every possibility of copyright infringement before it even starts, by completely separating the source and destination. Everyone who has ever read the copyrighted source is considered "tainted" and may not ever contribute any code to the "clean" destination. The readers and writers are two completely distinct teams, with only the known-clean specification passing between them.
LLMs, on the other hand, are fundamentally nothing more than a "code blender". You mix together giant piles of "tainted" code, and then statistically pull some combined fragments out of it. Following the clean-room legal argument, it should be treated as if everything coming out of it is tainted. There is, by definition, absolutely zero separation between input and output - and the early models verbatim reproducing popular F/LOSS code made that pretty obvious. LLMs are the literal opposite of a clean-room design!
Granted, going for the clean-room approach is overkill - and intentionally so. It is the nuclear option chosen when you believe the risk of getting sued is substantial. It is perfectly possible to write non-infringing code without using a clean-room approach, it is just a lot harder to defend in court when you get sued - be it justifiably or not. But "LLMs are non-clean-room non-infringing" is quite a different argument from "LLMs are clean-room, therefore non-infringing".
>I genuinely don't understand how one could possibly make that argument.
With perhaps a bit of genuine irony inasmuch as it's a real reversal from most of computing history, highly locked down proprietary software might actually be a place where a case could be made even with current LLMs. After all, have any LLMs (or anyone else who hasn't signed an NDA for that matter) ever seen the source code of iOS 27 or other Apple crown jewels for example? So if someone used one LLM to produce the factual spec of a piece of software whose code is not part of its training data, humans to verify it was indeed just an uncopyrightable factual spec, and then a separate isolated freshly initialized LLM to produce something exclusively from said spec, it might well work with respect to that specific target? Like yes, the LLM would be dirty as hell for other stuff, but only the copyright holder can sue. Apple couldn't sue the output on behalf of F/LOSS projects or copyright infringement in general, only with respect to its own.
In principle, I suppose this could also be extended with enough compute power to any arbitrary software. Build an LLM perfectly from scratch with a signed verified training set (which you save) that includes nothing of what you want to CRE, and you should be able to prove that it's "virgin" on that front. Of course in practice that'd mean jumping back in time and be super expensive right now, no current tainted LLM could be a base point. But maybe eventually compute will drop back down in price enough again, and/or meta breakthroughs in training, that for valuable enough CRE targets, someone might create a business around creating "CRE LLMs certifiably and legally/technically provably clean of any copyrighted material related to your target" which would still leave most of the corpus of human works. That could really disrupt a lot of the current regime.
F/LOSS I assume would actually be the most resistant to this in principle due to being insanely hard to not have be part of a core training set in any way.
And I stand corrected that it wasn't specifically the melody that the lawsuit accused of being copied. I still don't know what an "ostinado" is.
If Biz Markie has to clear all his samples (and he does[0]) then so should the Ramburglar.
https://en.wikipedia.org/wiki/Grand_Upright_Music%2C_Ltd._v.....
No.
American copyright law is very perverted compared to the original intent. 70 years after the death of the artist isn't exactly what the founding fathers envisioned to achieve the same benefits of the 15th century Venetian laws.
If we look at China's economy over the past 30 years, the ruthless competition created by making IP protections difficult to enforce yields better products and prices for the society, including massive wealth increases.
I'm not sure where I stand on whether LLMs violate IP when they spit out text. But I guess the easiest take is that companies who train their models on stolen creative works should be prosecuted. It's a shame that the US legal system can be so easily abused by defends with massive war chests.
All the worst outcomes involve taking AI away from regular people while only specific groups are allowed to benefit.
It didn't protect you. It only protects corporations rich enough to get enforce their IP.
At this point it is better that it goes away.
There was a case about this specific issue, and in order to protect billionaires from coders they effectively declared AI models "natural persons". 50+ times in the copyright act you will find only natural persons can originate copyright.
https://www.courthousenews.com/coders-lose-appeal-in-copyrig...
To give the money to billionaire corporations courts ruled DIRECTLY against established law. How much do you want to bet that when it comes to protecting ChatGPT AGAINST OpenAI, when it comes to protect Claude against Anthropic, courts will immediately do a 180 and declare them programs again?
If you look at past cases, it gets much worse. In order to justify a conviction against libraries using DRM to enforce lending, and because old licenses of course have zero language about digital copies, courts were willing to state that making a copy for fair use is not allowed if there is the mere potential for damage to the authors, as judged by the authors EVEN IF THE LICENSE EXPLICITLY ALLOWS IT. Of course, applying this to the above court case, there is no possible defense for OpenAI, after all, by that standard, the open source license doesn't even matter! That's how the law works for billionnaires. Outlawing DRM based lending has destroyed library access to an incredible amount of old works, and effectively denied access to old movies to Americans (because maintaining enough working physical copies over a large area is impossible). Whatever excuse gets the money to the billionaires!
There are many other totally absurd court judgements. For example, in order to get convictions where people didn't re-upload they had to judge that copies in buffers are also "distribution". NOT for billionaire telco's of course. Only the ones in your house. So courts judged that sending from your modem to your computer is distribution but sending over 1000 routers from Los Angeles to Athens is not! WHATEVER protects the billionaires.
As for this court case, obviously it is trivial to make a ML model that just outputs what it gets as input. Make a byte transformer, and just have diagonal matrices as layers. Boom! Done. You can also make it somewhat smarter. Let's make it copy, but make snow white a 220 pound black dude. There is a severe lack of color in old Disney movies anyway! You know, so there is no argument about transformation.
This obviously transforms its input. It's in the name. It's the EXACT same thing as ChatGPT, which according to courts originates copyright. Now run the Disney movies through it, and they'll be byte-identical BUT transformed to the input.
How much do you want to bet they'll still rule the money goes to Disney? Microsoft? But you can bet your left testicle courts will judge against it. Finding some excuse so the money keeps flowing to billionaire corporations, that's all courts do.
So Harry Potter?
Do you have some specific, actual examples you can share?
I’ve been hearing this exact claim for years, but every time I ask for a specific example, any example at all, I can’t seem to find anything more than a highly generic snippet of code or a coerced continuation.
He basically said, "I know, there's nothing I can do."
This is a sparse matrix library, IIRC. Numerical linear algebra and applications using it are black art at this point. I have written a Boundary Element Method evaluator for my Ph.D., and know what it entails to work with these things.
Doing fast operations on sparse matrices is a cutthroat race and when you can shave your hot path by seconds, your solution can save hours in some cases. So, it's an interesting niche. i.e.: It's no ordinary boilerplate.
While I worked with dense matrices; the effect, difficulty, blood sweat and tears are still there.
When a model can give back your hard work back to you with a "completion" without attribution, that's bad.
These algorithms' design starts on paper, as pure maths. You get the analytic form, and convert this to numerical/discrete form and start to design from there.
You need to add normalization, subnormal number prevention, maybe some architecture specific optimization if you are targeting a specific CPU generation, etc. Then it gets optimized further as you run tests, profile the code and run your test cases.
So, no BLAS package looks the same, because they make different trade-offs, have different programming models, and handle things differently, at different points. Even more so, a newer generation processor with much higher FPU performance can have lower performance than previous generation, so you implement another copy of that function or add to detect that processor and have different paths just for that one.
IOW, when doing numerical maths on processors, esp. if you're doing this on many machines with MPI or multiple cores with hand rolled code or OpenMP, there's no single way. Maybe a best way for the specific CPU you have, but it still depends on the trade-offs and design choices you made in the very beginning.
The design of those macros is more art than science.
You’re disqualifying any example that people may provide preemptively. No wonder you’ve missed them.
By “forced continuation” I mean the type of example that was popular for a while where someone would feed a lot of text into LLMs and then ask it to continue the text, then be surprised when it some times predicted the next tokens identical to the original example.
Do this enough times and you can find “examples” that prove your point, but it’s highly automatable so people were using it like a million monkeys at a million typewriters.
I know software patents, the worst idea in IP, do exist, but I think they're as toxically bad an idea now as they were decades before AI, when they were first invented.
You shouldn't be able to own an overall implementation idea. If you can, then Microsoft, Oracle, or Meta can too, and can start suing everyone for 'ripping off' an idea that they happened to come up with first. In that world, you'd have to consult a copyright-police AI (ironically) after every function you write, to scan it for ideas someone else has claimed. "Sorry, the function PadStringL() in this JavaScript is too similar in implementation to str_lpad(), from an AGPL library for perl that was released in 1998."
It probably is, if they didn't have the chops to write it internally. But to them, the trade-off is probably worth the benefit of ditching a component with AGPL.
Personally I just release everything I publish under MIT to make it as easy a as possibly to use.
Look up the "Malfoid" trend. Not my cup of tea as they say, but it seems many others are enjoying the plentiful entertainment of AI-assisted derivative works.
One company first pirated my AGPL code (e.g. shipped it without my name, copyright notices, source availability, etc.). I sent them violation notices. After many months of fighting, they had an LLM clone the system. The LLM clone feels:
a) Buggy and bad compared to my code
b) Still, like it's basically my creative content
It's as if you asked an LLM to rewrite Harry Potter, with the same plot, but bad dialogue.