News for hackers. Stuff that matters.
Re:Let's Not Flip Sides on IP Maximalism Because of AI by ajnin on Thursday November 30, 2023 @08:24AM (#38473172)
> 100 GB of weights don't resemble any work

I don't think that argument has a lot of weight. By the same logic a zip file of a book doesn't resemble the original work if you look at the raw bytes but you can extract it and get it back. It would be hard to argue that the copyright violation happens only when you extract the zip, and not, say, if you distribute the archive.

Re:Let's Not Flip Sides on IP Maximalism Because of AI by panta on Thursday November 30, 2023 @08:41AM (#38473390)
LLM could even be seen as a form of lossy compression after all
Re:Let's Not Flip Sides on IP Maximalism Because of AI by datadrivenangel on Thursday November 30, 2023 @09:48AM (#38474165)
A sufficiently overfit model is indistinguishable from bad compression.
Re:Let's Not Flip Sides on IP Maximalism Because of AI by Barrin92 on Thursday November 30, 2023 @08:43AM (#38473403)
The same logic doesn't apply because you can't get the data back out of the model by unpacking it. It's theoretically not possible because the model is magnitudes smaller than the totality of the data.

To use, and invert the example from the other commenter, you can even get an existing poem out of a generative model that genuinely was not in the training data at all. This is because it's not an archive, which does correspond directly to one particular work, but a generative technology.

Re:Let's Not Flip Sides on IP Maximalism Because of AI by danaris on Thursday November 30, 2023 @09:17AM (#38473787)
If I create an original file in Photoshop that's 8K, then produce a JPG of it, the JPG is both orders of magnitude smaller, and clearly a rendition of the same work. There's no way to get back to the original 587MB 8K PSD from the 87KB 1024x768 JPG, but that's irrelevant to whether the latter is a version of the former.

Just because the models are not perceptually the same as their training data does not mean that they are not effectively a lossy compression of that data.

Re:Let's Not Flip Sides on IP Maximalism Because of AI by SilasX on Thursday November 30, 2023 @09:58AM (#38474276)
Right, the LLM is more like the zip algorithm than the zip file. Yes, if you feed certain bits (the zip file) to the zip algorithm, you can get a copyrighted work out, but that means the zip file is violating, not the zip software.
Re:Let's Not Flip Sides on IP Maximalism Because of AI by Marazan on Thursday November 30, 2023 @09:20AM (#38473816)
But people absolutely have extracted individual source images out of the models by not even particularly careful prompting.
Re:Let's Not Flip Sides on IP Maximalism Because of AI by artifabrian on Thursday November 30, 2023 @09:30AM (#38473924)
That's absolutely not true.

You might get replicas of incredibly popular works like Mona Lisa due to overfitting but that's it.

If I am wrong please do provide an example as this is very relevant and interesting (and impossible from an information theory pov).

Re:Let's Not Flip Sides on IP Maximalism Because of AI by Marazan on Thursday November 30, 2023 @09:47AM (#38474149)
https://www.technologyreview.com/2023/02/03/1067786/ai-model...

The approach I've seen is to prompt for people with unusual names, they're often be only a single source image in the input data set that gets reproduced by the AI.

I've seen examples with the AI "generated" images and the source image side by side - I'll try and find them.

EDIT: Link to the paper https://arxiv.org/abs/2301.13188 and this articles has the example images: https://www.theregister.com/2023/02/06/uh_oh_attackers_can_e... Look at the Ann Graham Lotz image and tell me that isn't the source image being reproduced in a lossy manner.

Re:Let's Not Flip Sides on IP Maximalism Because of AI by otabdeveloper4 on Thursday November 30, 2023 @12:54PM (#38476595)
So if I lossily compress a novel so random typos and spelling errors are introduced then it isn't copyright infringement?

Wow, that changes everything. BRB, I got books to pirate.