News for hackers. Stuff that matters.
Re:Stable Diffusion copyright lawsuits could be a legal eart... by bugglebeetle on Monday April 03, 2023 @10:18AM (#35423986)
> Erik Wallace, a computer scientist at the University of California, Berkeley, told me in a phone interview that the lawsuit had “technical inaccuracies” and was “stretching the truth a lot.” Wallace pointed out that Stable Diffusion is only a few gigabytes in size—far too small to contain compressed copies of all or even very many of its training images.

>In reality, Stable Diffusion works by first converting a user’s prompt into a latent representation: a list of numbers summarizing the contents of the image. Just as you can identify a point on the Earth’s surface based on its latitude and longitude, Stable Diffusion characterizes images based on their “coordinates” in the “picture space.” It then converts this latent representation into an image.

Regardless of the lawsuit, this seems like a quite spurious, self-serving argument in and of itself. If the “coordinates” of the image were not equivalent to the image, how would it be possible to fine tune the model on a set of images and recreate their style? This is setting aside the myriad examples where SD regurgitates fairly close copies of individual works.

This is a bit like training a model on the works of Shakespeare, but then claiming that the tensors resulting from ingesting the data are not actually Shakespeare’s writing. Oh really, where’d they come from then? Thin air?

Re:Stable Diffusion copyright lawsuits could be a legal eart... by justrealist on Monday April 03, 2023 @10:36AM (#35424305)
Yes but an alternate view of the copyright is that a person get a degree in English literature and carefully reads all of Shakespeare's writing, and then goes onto write a screenplay which thematically derives from Hamlet.

Obviously you get the Shakespeare influence, but the bar on copyright infringement is very high for a reason — we don't want to sue artists for being influenced by another writer.

Re:Stable Diffusion copyright lawsuits could be a legal eart... by bugglebeetle on Monday April 03, 2023 @11:00AM (#35424769)
I don’t really care about the copyright argument as it relates to human learning because I think this is all a Napster-style false flag by capital owners to enclose ALL data on the internet. The intent isn’t to argue about these models from first principles such that we all have IP-restriction free access from them. It’s to make them do enough legally gray things at scale that they get restricted to only a few power players.
Re:Stable Diffusion copyright lawsuits could be a legal eart... by larry_ralph_ on Monday April 03, 2023 @02:39PM (#35429135)
Rubbish. Make a reasonable argument instead of playing at being a communist. 'Capital owners' bankrolled the company that manufacturers the device you used to type your asinine comment, as well as the companies that manufacture everything you own.

And if you despise capitalism so much, put your money where your mouth is and relocate to Cuba.

Champagne pseudo-socialists like you give the rest of us liberals a bad name.

Re:Stable Diffusion copyright lawsuits could be a legal eart... by bugglebeetle on Monday April 03, 2023 @03:21PM (#35429803)
I made a reasonable argument: the intent with Stable Diffusion is to do the same thing that many startups have done, i.e. break the law enough that you establish a dominant market position/raise a ton of money, but create enough externalities that the state has to intervene. Then, bribe politicians to legalize your former law breaking and to lock out any of your competitors. This is what myriad companies in the gig economy have done, for example.

Instead of reflexively spewing a series of ideological non-sequiturs, perhaps engage with what I actually said.

Re:Stable Diffusion copyright lawsuits could be a legal eart... by larry_ralph_ on Monday April 03, 2023 @03:51PM (#35430266)
>bribe politicians to legalize your former law breaking and to lock out any of your competitors

Could you name a single startup in the US that has been caught 'bribing' politicians?

And stop drinking the Uber/WeWork/Airbnb/ kool-aid. The vast majority of startups are founded by honest people, and don't rely on breaking laws in order to establish a dominant market position or 'raise a ton of money', I should know, I'm an early employee at a startup with a 'dominant market position'.

Yes you should demonise people for any criminal actions they've actually committed, but please don't demonise them simply for being successful.

All of your comments on this thread sound as though they're made by a college undergrad still in the anti-capitalist/hippy-communist stage.

Grow up! Most things in life are not conspiracies and believing they are will significantly harm your emotional health.

Re:Stable Diffusion copyright lawsuits could be a legal eart... by bugglebeetle on Monday April 03, 2023 @04:18PM (#35430668)
It seems as if I live more in the “real world” than your fantasies about how the world of business actually operates:

https://theguardian.com/news/2022/jul/10/uber-files-leak-rev...

Oh, but of course, only if I set aside the “kool-aid” of citing the examples of the dominant startup players of the past decade.

Perhaps you should, again, grow beyond your ideological name-calling to a rational engagement with the world, which actually involves everything I’ve described.

Re:Stable Diffusion copyright lawsuits could be a legal eart... by larry_ralph_ on Monday April 03, 2023 @05:05PM (#35431287)
I did a word search of the linked article you posted, and I didn't see a single incidence of the words 'bribe' or 'bribery' in it.

Or are you claiming that the word "lobby" in the phrase "attempts to lobby Joe Biden, Olaf Scholz and George Osborne" actually meant 'bribe'?

And despite you frantically scouring Google for something to backup your 'bribery' claims with, the above article ended up being the only thing you could find.

So basically, you essentially spent your own time to prove my point. Thanks.

I'll repeat again what I told you earlier: grow up and stop gorging yourself on conspiracy theories.

Signing off!

Re:Stable Diffusion copyright lawsuits could be a legal eart... by bugglebeetle on Monday April 03, 2023 @05:26PM (#35431515)
Yes, with your love of cherry picking, if you exclude the financial “lobbying” Uber has done, understood as bribery and largely illegal in every country beside the U.S., then no bribery occurred!

If anything, all this thread had demonstrated is an extreme need on your behalf to defend your belief in a tooth-fairy version of Capitalism, and scream “COMMUNIST” and plug your ears whenever confronted with reality of mommy and daddy startup putting money under politician’s pillows to win their place in the world.

Re:Stable Diffusion copyright lawsuits could be a legal eart... by justrealist on Monday April 03, 2023 @09:41PM (#35433887)
> understood as bribery and largely illegal in every country beside the U.S

Do you genuinely believe this?

Re:Stable Diffusion copyright lawsuits could be a legal eart... by bugglebeetle on Monday April 03, 2023 @10:07PM (#35434057)
Do I genuinely believe that startups funneling millions of dollars to politicians in campaign donations, speaking fees, and giving them plush gigs when they leave office is a legalized form of bribery? Yes. Is most of this illegal in other developed democracies? Yes.

I feel like after the whole SBF fiasco this should all be quite obvious…

Re:Stable Diffusion copyright lawsuits could be a legal eart... by dang on Sunday April 09, 2023 @07:39PM (#35507559)
I'm late to this, but both of you broke the site guidelines badly in this thread. Please don't do flamewars on HN, and especially please avoid tit-for-tat spats, in the future. We ban accounts that get into this sort of thing regularly; it's not what this site is for, and destroys what it is for.

You've posted some good comments in other threads, so hopefully this should be easy to fix if you review https://news.ycombinator.com/newsguidelines.html and take the intended spirit of the site more to heart. We'd be grateful!

Re:Stable Diffusion copyright lawsuits could be a legal eart... by dang on Sunday April 09, 2023 @07:38PM (#35507556)
I'm late to this, but both of you broke the site guidelines badly in this thread. Please don't do flamewars on HN, and especially please avoid tit-for-tat spats, in the future. We ban accounts that get into this sort of thing regularly; it's not what this site is for, and destroys what it is for.

You've posted some good comments in other threads, so hopefully this should be easy to fix if you review https://news.ycombinator.com/newsguidelines.html and take the intended spirit of the site more to heart. We'd be grateful!

Re:Stable Diffusion copyright lawsuits could be a legal eart... by GaggiX on Monday April 03, 2023 @10:25AM (#35424102)
If trained correctly the model could easily reproduce any arbitrary image if you know its coordinate in the latent space (and you use deterministic sampler), regardless of whether the image is present in the dataset or not, it's also easy to imagine as the coordinates are as big as the samples generated by the diffusion model. You can take an image and use DDIM inversion to find the coordinates.
Re:Stable Diffusion copyright lawsuits could be a legal eart... by Kim_Bruning on Monday April 03, 2023 @10:58AM (#35424729)
You can use SD models to draw portraits of people (or anime characters, say) based on their description.
Re:Stable Diffusion copyright lawsuits could be a legal eart... by threepio on Friday April 07, 2023 @07:48PM (#35488677)
> You can take an image and use DDIM inversion to find the coordinates

I'd like to try this. Any suggestions where I can learn how to implement this technique?

Re:Stable Diffusion copyright lawsuits could be a legal eart... by alex_sf on Monday April 03, 2023 @10:52AM (#35424616)
> Regardless of the lawsuit, this seems like a quite spurious, self-serving argument in and of itself. If the “coordinates” of the image were not equivalent to the image ...

It's simply not. Stable Diffusion 1.5 was trained on over two billion images. Even if we assume the images were only 10kb on average, that would require 20TB of storage space. The pruned 1.5 model is only 4.27GB, or 4,684x smaller. It is fundamentally and provably impossible to achieve that sort of compression ratio on diverse and already compressed images.

'Coordinates of the image' is a layman's explanation of latent space and the training process, it should not be taken literally.

> how would it be possible to fine tune the model on a set of images and recreate their style?

The fine tune process represents additional training, and to reliably and consistent reproduce a consistent style generally requires overfitting. It is very roughly analagous to an artist using a reference while drawing/painting.

> This is setting aside the myriad examples where SD regurgitates fairly close copies of individual works.

Some works were overrepresented in the dataset because they are overrepresented in the world. There are substantially more images and variants of the Mona Lisa on the internet than there are Random Twitter Artist's Furry Waifu.

This works in much the same way for humans, who are more far more likely to be influenced by the Mona Lisa than Furry Waifu.

> This is a bit like training a model on the works of Shakespeare, but then claiming that the tensors resulting from ingesting the data are not actually Shakespeare’s writing.

.. They aren't. Shakespeare did not write them. His works can't be reproduced from them. There is, provably, not enough data for it. This is more different than if an individual read and referenced Shakespeare while writing a play, for all that entails. Specifically: whether it's a human or a model generating the content, the content that is generated could be a violation of copyright.

You'll note that this is no different to if I copy and paste Mickey Mouse onto a tshirt design, or if I draw him on a piece of paper with a crayon.

Should we also be up in arms about copy/paste and crayons?

> Oh really, where’d they come from then? Thin air?

This hits on a more important point than I think you realize here. Where did inspiration for the human artists come from? Did they spring from a formless void? Or have they seen a lot of images, internalized what they think was important from it, and then generated art from that?

Re:Stable Diffusion copyright lawsuits could be a legal eart... by bugglebeetle on Monday April 03, 2023 @11:05AM (#35424883)
> They aren't. Shakespeare did not write them. His works can't be reproduced from them. There is, provably, not enough data for it.

Oh really? Try googling overfitting. Or ask ChatGPT!

Re:Stable Diffusion copyright lawsuits could be a legal eart... by alex_sf on Monday April 03, 2023 @11:13AM (#35425058)
You're not exactly communicating in good faith here, given that I addressed exactly this:

> The fine tune process represents additional training, and to reliably and consistent reproduce a consistent style generally requires overfitting ...

It's clear you have a perspective that is set in stone, and insist on not understanding the technology. Hopefully you'll re-evaluate when the plaintiffs in these suits inevitably lose.

Re:Stable Diffusion copyright lawsuits could be a legal eart... by bugglebeetle on Monday April 03, 2023 @11:42AM (#35425690)
No, I don’t care about the lawsuit because the intent with releasing SD was to get sued and then lock in a monopoly based on big players being the only ones capable of rights enforcement. See my other comment.

> I don’t really care about the copyright argument as it relates to human learning because I think this is all a Napster-style false flag by capital owners to enclose ALL data on the internet. The intent isn’t to argue about these models from first principles such that we all have IP-restriction free access from them. It’s to make them do enough legally gray things at scale that they get restricted to only a few power players.

Re:Stable Diffusion copyright lawsuits could be a legal eart... by unusualmonkey on Monday April 03, 2023 @10:57AM (#35424709)
> Regardless of the lawsuit, this seems like a quite spurious, self-serving argument in and of itself. If the “coordinates” of the image were not equivalent to the image, how would it be possible to fine tune the model on a set of images and recreate their style? This is setting aside the myriad examples where SD regurgitates fairly close copies of individual works.

This argument confuses an image and the style. The former is copyrightable, the latter is not.

Re:Stable Diffusion copyright lawsuits could be a legal eart... by bugglebeetle on Monday April 03, 2023 @11:06AM (#35424906)
In the US. In France and other countries, they’re not separable.
Re:Stable Diffusion copyright lawsuits could be a legal eart... by jacquesm on Monday April 03, 2023 @10:58AM (#35424745)
Finding a new form of data compression wouldn't suddenly abolish copyright.
Re:Stable Diffusion copyright lawsuits could be a legal eart... by nonbirithm on Monday April 03, 2023 @11:23AM (#35425282)
Sounds like a "color of bits" issue. In practice the courts would care about where the latent coordinates originated from, and if it were only possible to derive them from violation of copyright. Same issue with a copy of Titanic ripped from a decaying VHS and compressed into a bad quality AVI uploaded on a torrent tracker. At some point there's still an issue with unauthorized reproduction even if the bits don't match the master copy, because the "color" would still match. And "color" is not a thing that can be represented with data, it's abstract information.

https://ansuz.sooke.bc.ca/entry/23