They don't sell that exact work verbatim. It's part of their training as an artist. They don't sell their student assignment. It prepares to them to go on and create their own works, which of course, then they can sell.
In the same way the LLM is synthesizing new works based on training, not a 1:1 copy.
I'm not endorsing a particular perspective but you need to at least understand the argument if you're going to dismiss it.
If I have legal access to copyrighted artwork, the law permits me to train my skills by copying that artwork as long as I haven’t agreed not to.
If you want to pursue this digression, I would just caution you. Given how much information is "available" today I just really don't think this is a very compelling point. It seems quite obvious to me LLMs are a child of the internet, that is, of widely available data. They would have gotten sufficient availability at more or less the same pace eventually. It doesn't address the question of the copyright status of their own works at all to bring this up as if it proves something, because I presume you believe there are sufficient cases of theft in the training data to damn the entire effort.
Instead what is happening is people who can prove such violations of their own rights are suing and will be paid out, and the show will go on. Just like if a student downloads a PDF we don't expect to garnish their wages in perpetuity.
If data for a computer program is literally "training," then I'd like to see a proof that going to college is literally updating weights in a matrix to be processed by a class of computer programs.
I'd also like to rename "shooting people who annoy me" into "paying my taxes in full." That would do double duty, because I'd get to shoot people and my taxes would be covered.
> In the same way the LLM is synthesizing new works based on training, not a 1:1 copy.
This has nothing to do with the "training" argument. I can't reprint Harry Potter if I change every mention of Harry Potter into "Harry Cobbler." I also can't trade zip files of copyrighted material freely, although these don't resemble the original works at all. I can also, as a person, be trained to reproduce 1:1 copies of things. That makes it both indisputably training, and indisputably copyright violation.
The selection of paintings to be copied is particularly convenient because paintings can't be copied exactly (not even a photograph is an exact copy of a painting; it's the image of a painting that can hold a copyright, not the painting itself.) Texts, however, can be copied exactly, and many programmers began their own training by typing in programs from books with their own hands, which we were told would give us an instinct that would help us write our own programs. Those programs were obviously still protected by copyright, even when we typed them up ourselves.
People are playing propaganda games in order to pretend that the copyrights of LLM training material aren't being violated. They're rarely making logical or legal arguments. They just say something about a human learning and a computer "learning," and say since humans learn and own things that they produce based on that learning than computers should be able to "learn," and own things that they produce based on that "learning." It's a motivated word game, not a serious argument.
> A student goes and trains on preexisting work.
point is already shaky. Some of them kind of do?
I suspect this applies more to audio/visual than it does text or code.