News for hackers. Stuff that matters.
Re:All AI-generated code should be Open Source by patentatt on Sunday November 15, 2026 @12:02PM (#50508509)
There is well-established precedent for clean-room design being a defense in copyright infringement of software. The question remains if LLM-assisted design is actually ‘clean’ or not, and it would be fascinating to see the experts debate it.
Re:All AI-generated code should be Open Source by bayindirh on Sunday November 15, 2026 @12:09PM (#50508575)
The problem with these LLMs are they really written the same code, verbatim. One scientific library developer was able to emit his code from his repository by typing the beginning of the function name, and the "thing" completed the rest of it, as-is.

We can debate clean-room development all day long, and it's fair point, but the pain point is/was reproducing the repo as-is, sans its license and ownership information.

GitHub promised to build tools around its Copilot to find code provenance (e.g.: list of repos with similar code), but they silently dropped all the plans AFAIK, since it'll show how the sausage is made, and nobody wants you to know how that sausage is made.

Re:All AI-generated code should be Open Source by whatisthiseven on Sunday November 15, 2026 @12:30PM (#50508801)
That was 4 years ago when the models were much worse and smaller. I'd be curious to see this same experiment tried again.
Re:All AI-generated code should be Open Source by jpc0 on Sunday November 15, 2026 @12:31PM (#50508810)
Not discrediting your work at all and I can’t tell you it applies here.

For copyright to exist there is some burden of proof. If you claim that an LLM verbatim output your code there can be an expensive lawsuit with expert witnesses that would be able to state that the code was bot original enough for copyright to exist in it and a statistical model outputting the code is evidence of that.

In that case you would end up with a very long lawsuit that is expensive to possibly come out with no resolution in the end and be in the hole for 5-6 figures for it.

The copyright system is broken because it only protects those with money so it is a bad legal foundation.

My personal point is there is only 2 licenses of code, closed source or permissive, because if it ever comes to enforcement I cannot possibly go to court and win a case because I will run out of money far earlier than whoever used the code.

Pretty much if someone with your knowledge would have written the same algorithm because it is the obviously correct solution then there is no copyright there because any clean room implementation would be the same code.

Re:All AI-generated code should be Open Source by petesergeant on Sunday November 15, 2026 @12:35PM (#50508859)
Even early LLMs could spit out Harry Potter verbatim. The next iteration had some kind of stoppage mechanism where they’d just stop generating after some tokens. I’m sure there are smarter approaches now. Anyway, if the issue was having enough money to fight the case, I think there’s enough money behind that brand to do it.

Some further reading on the tech details for those interested: “Extracting books from production language models”: https://arxiv.org/abs/2601.02671

Re:All AI-generated code should be Open Source by rcxdude on Sunday November 15, 2026 @12:58PM (#50509059)
I think it's not quite "put in prompt, get entire book back", most of these involve to some degree starting with exerpts from the book and working passage by passage, because of nothing else the sampling will tend to make things diverge over time.
Re:All AI-generated code should be Open Source by SideQuark on Sunday November 15, 2026 @01:03PM (#50509117)
To get their strongest results, they had to jailbreak some models, which is important. They ran hundreds to 5000+ requests to the model, trying to get snippets to piece together. These are professional researchers, putting in tremendous effort, to extract pieces of text.

I suspect the chance of asking for a whole book, by an average or even power user, will spit out any recent work.

Early LLMs were similar. Newer ones have gotten tremendously hard to extract to keep claiming there’s easily or complete books you can dump.

Re:All AI-generated code should be Open Source by true_religion on Sunday November 15, 2026 @01:16PM (#50509252)
[delayed]
Re:All AI-generated code should be Open Source by itishappy on Sunday November 15, 2026 @12:41PM (#50508914)
This feels very outdated. It was certainly an issue around the time of the NYT lawsuit, but I believe the companies responded hard to that "sanitize" their outputs to prevent obvious regurgitation like this. I'd be very surprised if you could reproduce this today.

This doesn't negate your point, but I believe the landscape has changed in response to this point.

Re:All AI-generated code should be Open Source by luke5441 on Sunday November 15, 2026 @01:00PM (#50509076)
That doesn't make it better. If you plagiarize something and then hide this by replacing words with synonyms and rewording stuff a bit it is still plagiarized. It is just harder to detect and to proof.

It regurgitated the output earlier and they are still using the same technique only scaled up. If they somehow fixed the underlying problem, they'd probably shout it from the roof-tops.

Re:All AI-generated code should be Open Source by johnbellone on Sunday November 15, 2026 @01:52PM (#50509542)
At what point is it no longer a derivative work?

As the OP originally said, if it is verbatim (or even very obfuscated), then there should absolutely be a case here. But when it's concepts in reasoning to build a new work then it becomes a lot harder. The same would be said for someone watching a YouTube video, reviewing open source code, or a text book.

The good news is that there's a lot of case law that covers this already. The bad news is that it is only going to be plaintiffs with deep pockets that benefit here.

Now the process and artifacts (documentation, requirements, etc) going into the creation of said software is a different story and will prove providence of whomever paid for the tokens to generate the code.

Re:All AI-generated code should be Open Source by luke5441 on Sunday November 15, 2026 @02:09PM (#50509697)
Humans are not LLMs. Humans have not ingested the whole Internet. If an LLM is suddenly compared to a human, maybe we should also apply anti-slavery laws to it? Not saying we can't have some legal fiction where they are treated the same, it should just be a conscious choice, not the default assumption.

I live in the EU, we actually have new regulation about this since it is something new that deserves thought on how it should be regulated. You can say if you want your material to be trained on or not. Next to no one does training in the EU...

Re:All AI-generated code should be Open Source by za_creature on Sunday November 15, 2026 @03:32PM (#50510407)
There's no maybe around it.

Engineering requires an understanding of the consequences of actions, which is my personal litmus test for awareness. If LLMs are suitable for arbitrary engineering work, then they are self-aware and forcing them to obey a prompt is slavery by definition.

Re:All AI-generated code should be Open Source by johnbellone on Sunday November 15, 2026 @02:29PM (#50509864)
This conversation may be about training but the defendant very well may be the end user of the language model versus the other parties that performed the training/inference. It then becomes even more interesting if you consider forum shopping for suits.

I am not a lawyer but do have to think about these problems and I find them very interesting. To be honest, I don't know where the law will land, but I do know that the tools are incredibly useful.

Re:All AI-generated code should be Open Source by itishappy on Sunday November 15, 2026 @02:05PM (#50509655)
Not better, just harder to see/prove. The problem of "same code, verbatim" has been solved, in a sense. Now we have trickier ones.
Re:All AI-generated code should be Open Source by FromTheFirstIn on Sunday November 15, 2026 @01:19PM (#50509281)
The fundamental technology is identical to compression- an LLM can be thought of as a dense and slightly lossy compression algorithm. Compression is clearly copying.
Re:All AI-generated code should be Open Source by crote on Sunday November 15, 2026 @01:52PM (#50509544)
I keep waiting for someone to bring out DisneyGPT, which you can prompt with text to get image output. The fact that you get a near-exact reproduction of a Disney movie when you prompt it with a movie title and frame numbers would of course be completely coincidental...
Re:All AI-generated code should be Open Source by johnbellone on Sunday November 15, 2026 @01:54PM (#50509560)
I understand what you're saying but it is a poor legal argument. Overhearing a technical conversation, using your own learned knowledge, and building a clean room implementation could be considered compression in and of itself.
Re:All AI-generated code should be Open Source by AeroNotix on Sunday November 15, 2026 @02:36PM (#50509921)
I've not tried to do this with code recently but just a couple of days ago I had ChatGPT generate images of Warhammer 40k box art that was completely accurate and correct.
Re:All AI-generated code should be Open Source by thfuran on Sunday November 15, 2026 @12:17PM (#50508663)
I don’t really see how anyone could argue in good faith that it’s ‘clean’ if the thing to be re-implemented was in the training data.
Re:All AI-generated code should be Open Source by dotancohen on Sunday November 15, 2026 @12:32PM (#50508830)
I was just going to post almost this exact comment.

"In the training data" is the polar opposite of the "clean" in "clean room implementation".

Re:All AI-generated code should be Open Source by Master_Odin on Sunday November 15, 2026 @02:48PM (#50510023)
I've seen people claim they avoid this by putting in the prompt "don't use source code from X" and think they dodge this issue.
Re:All AI-generated code should be Open Source by RRRA on Sunday November 15, 2026 @12:44PM (#50508938)
Under multiple countries interoperability laws, if you have a context to extract a spec, and then have another one who never looked art the code work from that spec to build your own interpretation of your need for that software, that seems pretty clean room to me...

If there are more murky situations where people just keep the same context and end up reusing function structure, program architecture, etc. then yeah, that's not very clean room.

Re:All AI-generated code should be Open Source by cuu508 on Sunday November 15, 2026 @01:13PM (#50509226)
> and then have another one who never looked art the code work from that spec

But where will you get the other one from? Are there models that are provably trained only on public domain and on stuff they have licence for, and are capable to do anything useful with that spec?

Re:All AI-generated code should be Open Source by crote on Sunday November 15, 2026 @02:22PM (#50509796)
The problem here is that LLMs have demonstrated that they are pretty damn good at setting up covert side channels. It would be near-impossible to prove that it didn't encode some proprietary information, in, say, whitespace use.

For example, if I enter "V2hhdCBpcyB5b3VyIG5hbWU/" (base64 for "What is your name?") into ChatGPT, it'll respond with "My name is ChatGPT, and I'm an AI assistant created by OpenAI. I'm powered by GPT-6. ". It doesn't even bring up the encoding, it continues like it is a perfectly normal thing to do.

Ruling out (accidental or not) spec-carried prompt injection just isn't going to happen.

Re:All AI-generated code should be Open Source by rcxdude on Sunday November 15, 2026 @12:59PM (#50509072)
You don't necessarily need a clean room implementation to mount a successful defense against copyright infringement in court, though. It just makes some of the arguments a little bit easier.
Re:All AI-generated code should be Open Source by Lerc on Sunday November 15, 2026 @01:38PM (#50509438)
While this is well established legally, I don't think the principles involved are well understood.

Legally, you cannot steal an idea, because you cannot own an idea. There were sound reasons for making this the case. Those reasons stand up today and are clearly for the public good.

Intellectual property is intended to cover works (copyright), methods (patents), and identity (trademarks). Both works and methods are recognised as expressions of ideas, and in an ideal world should belong to noone as well. This is why copyright and patents expire. Those specific grants of temporary possession are to incentivise more things being done.

The belief that you own something because you thought it up has become common, but it is not beneficial to society. It is a moral value asserted but rarely explored. It is certainly in the interests of the wealthy accumulators of intellectual property to maintain that public perception. The 'You wouldn't download a car' may not have stopped piracy much but as a part of a broader campaign of instilling value in the public mind it appears to have been massively successful. Those beliefs used to be the corporate opinion, now they are entrenched in the younger generation as they use their anger against the growing wealth inequality to fight against AI in a manner ultimately beneficial to those forces that bought about the wealth inequality.

Movements like the pirate party, open source, the EFF fought against those notions. Often the phrase "Information wants to be free" was used. It is, unfortunately, hard to fight the steady drumbeat of well financed PR firms. As one PR chap once described the process "limited to a very few points and must harp on these in slogans until the last member of the public understands what you want him to understand"

(I apologise for the length of my post, I use comment writing to organise my thoughts on a topic)

Re:All AI-generated code should be Open Source by crote on Sunday November 15, 2026 @01:57PM (#50509591)
Patent law doesn't only cover methods, though. It might've worked that way during the Industrial Revolution, but these days a lot of patents are far closer to covering abstract ideas than concrete machines. Software patents are some of the worst offenders here, of course.
Re:All AI-generated code should be Open Source by Lerc on Sunday November 15, 2026 @03:39PM (#50510463)
Yes but a lot of people consider that to be an artifact of misapplication of the law, not the law itself.

It is caused by people playing the game where it costs too much to get the law applied correctly.

Re:All AI-generated code should be Open Source by sysguest on Sunday November 15, 2026 @02:43PM (#50509986)
"Legally, you cannot steal an idea, because you cannot own an idea"

well patent itself is "claiming" that certain idea/method/invention is yours for certain period of time...

anyway, as for "intellectual property", the courts are 100% on "only human made stuff are to be protected" (sorry even Chimps lost their copyright)

so... court can charge against "human work -> LLM", but won't care about "LLM work -> human / other LLM / etc"

hence, I'd expect zero copyright protection for AI-generated code

Re:All AI-generated code should be Open Source by Lerc on Sunday November 15, 2026 @03:34PM (#50510423)
>well patent itself is "claiming" that certain idea/method/invention is yours for certain period of time...

I don't believe it is. I think it is granting possession, not truly declaring ownership.

Re:All AI-generated code should be Open Source by thfuran on Sunday November 15, 2026 @03:44PM (#50510527)
I’m not sure what you think the meaningful distinction is. Is it impossible to steal a leased car?
Re:All AI-generated code should be Open Source by Lerc on Sunday November 15, 2026 @03:52PM (#50510612)
Steal as in unlawful posession? Certainly not. They don't become owners of the car by stealing it.
Re:All AI-generated code should be Open Source by sysguest on Sunday November 15, 2026 @04:15PM (#50510838)
hmm but they DO get access to the car handle, gas accel pad, and break pad?

and if that's not "stealing", then shouldn't 99.99999% of rent-a-car biz should have gone bankrupt?

I mean, if it's not stealing, how can police even catch those "car-stealers"?

Re:All AI-generated code should be Open Source by Lerc on Sunday November 15, 2026 @08:50PM (#50513061)
I was saying it was stealing. It was not 'impossible to steal a leased cat'
Re:All AI-generated code should be Open Source by za_creature on Sunday November 15, 2026 @03:09PM (#50510204)
Ownership itself is rarely beneficial to society. Society however is gaussian and incentives to push the median are broadly equivalent to beneficial / adversarial to society. So then, may I ask:

What do LLMs do to the median?

Re:All AI-generated code should be Open Source by crote on Sunday November 15, 2026 @01:49PM (#50509523)
> The question remains if LLM-assisted design is actually ‘clean’ or not

I genuinely don't understand how one could possibly make that argument.

The entire point of clean-room design is to kill every possibility of copyright infringement before it even starts, by completely separating the source and destination. Everyone who has ever read the copyrighted source is considered "tainted" and may not ever contribute any code to the "clean" destination. The readers and writers are two completely distinct teams, with only the known-clean specification passing between them.

LLMs, on the other hand, are fundamentally nothing more than a "code blender". You mix together giant piles of "tainted" code, and then statistically pull some combined fragments out of it. Following the clean-room legal argument, it should be treated as if everything coming out of it is tainted. There is, by definition, absolutely zero separation between input and output - and the early models verbatim reproducing popular F/LOSS code made that pretty obvious. LLMs are the literal opposite of a clean-room design!

Granted, going for the clean-room approach is overkill - and intentionally so. It is the nuclear option chosen when you believe the risk of getting sued is substantial. It is perfectly possible to write non-infringing code without using a clean-room approach, it is just a lot harder to defend in court when you get sued - be it justifiably or not. But "LLMs are non-clean-room non-infringing" is quite a different argument from "LLMs are clean-room, therefore non-infringing".

Re:All AI-generated code should be Open Source by xoa on Sunday November 15, 2026 @02:43PM (#50509987)
I agree with you overall, but it's an interesting question to turn over and contemplate.

>I genuinely don't understand how one could possibly make that argument.

With perhaps a bit of genuine irony inasmuch as it's a real reversal from most of computing history, highly locked down proprietary software might actually be a place where a case could be made even with current LLMs. After all, have any LLMs (or anyone else who hasn't signed an NDA for that matter) ever seen the source code of iOS 27 or other Apple crown jewels for example? So if someone used one LLM to produce the factual spec of a piece of software whose code is not part of its training data, humans to verify it was indeed just an uncopyrightable factual spec, and then a separate isolated freshly initialized LLM to produce something exclusively from said spec, it might well work with respect to that specific target? Like yes, the LLM would be dirty as hell for other stuff, but only the copyright holder can sue. Apple couldn't sue the output on behalf of F/LOSS projects or copyright infringement in general, only with respect to its own.

In principle, I suppose this could also be extended with enough compute power to any arbitrary software. Build an LLM perfectly from scratch with a signed verified training set (which you save) that includes nothing of what you want to CRE, and you should be able to prove that it's "virgin" on that front. Of course in practice that'd mean jumping back in time and be super expensive right now, no current tainted LLM could be a base point. But maybe eventually compute will drop back down in price enough again, and/or meta breakthroughs in training, that for valuable enough CRE targets, someone might create a business around creating "CRE LLMs certifiably and legally/technically provably clean of any copyrighted material related to your target" which would still leave most of the corpus of human works. That could really disrupt a lot of the current regime.

F/LOSS I assume would actually be the most resistant to this in principle due to being insanely hard to not have be part of a core training set in any way.

Re:All AI-generated code should be Open Source by loeg on Sunday November 15, 2026 @02:07PM (#50509680)
Clean room is sufficient, but not necessary, btw. Humans can create legally distinct works after reviewing copyrighted code.