News for hackers. Stuff that matters.
Re:Adobe Firefly: AI Art Generator by egypturnash on Tuesday March 21, 2023 @12:21PM (#35248404)
I am definitely glad to see attention being paid to ethical sourcing of training images but I am curious: did the people who made all those stock images get paid for their work being used for training? Or is there a little clause lurking in the Adobe Stock agreement that says this can be done without even a single purchase happening?
Re:Adobe Firefly: AI Art Generator by anigbrowl on Tuesday March 21, 2023 @01:14PM (#35249267)
I'm sure that's a no. When you license a stock image you license it for any use whatsoever. You don't get to complain if it becomes the background to a porn movie or an advert for a product or person you despise. Songs can licensed on a case-by-case basis but images are so plentiful as to be a commodity.
Re:Adobe Firefly: AI Art Generator by ghaff on Tuesday March 21, 2023 @01:41PM (#35249661)
Not quite. For example, this is one thing Adobe says in their FAQ: Images showing models can't be used in a manner that the models could perceive as offensive. (For example, avoid using images with models on the cover of a steamy romance novel or a book about politics or religion, etc.)

There are also a few other more Adobe-specific restrictions.

Re:Adobe Firefly: AI Art Generator by anigbrowl on Tuesday March 21, 2023 @10:02PM (#35255792)
Well, Adobe are publishers of the stock images so they can enforce such terms. What I mean is that the person selling a stock image to Adobe, Getty, Shutterstock or whoever has no say on what happens to it afterward. The publisher is going to assert universal rights in exchange for cash. If they narrow their own terms as in your example above, they don't necessarily create any sort of duty to the seller whose photo rights they purchased.

I should have been clearer and specified sale of rights rather than licensing of a stock image in my original reply, which I now realize is confusing.

Companies certainly can offer more narrow terms/commitments about what the stock images can or cannot be used for if they want to, but economically they're incentivized to maximize their own freedom, and not to negotiate a complex bundle of rights for individual images. Of course for journalistic and artistic images that are unique in some way, the original creator can negotiate.

Re:Adobe Firefly: AI Art Generator by ghaff on Tuesday March 21, 2023 @11:18PM (#35256390)
It's probably not very common but people can and will absolutely bring lawsuits if you misrepresent them based on stock photography including but not limited to manipulating the photographs. (Of course, people can sue for whatever reason but using random stock photos for "bad people" can get you in trouble.)
Re:Adobe Firefly: AI Art Generator by janekm on Wednesday March 22, 2023 @07:24AM (#35259449)
That's not what happens when you sign a contributor license with Adobe, Getty, Shutterstock or other stock image libraries... These companies pay you 0 until the time a customer of theirs acquires a license to reproduce the image you contributed. Only at that point do you get paid a percentage of the license fee. Currently nobody has been paid anything by Adobe for their stock images used in the training (at least as far as I know).
Re:Adobe Firefly: AI Art Generator by anigbrowl on Wednesday March 22, 2023 @07:49PM (#35268689)
Sure, but once you sign you're agreeing to whatever terms are in force at the time of signing. I would guess that Adobe granted itself universal rights to do whatever they think will bring the customers in, but I haven't looked at one of their contracts.
Re:Adobe Firefly: AI Art Generator by wahnfrieden on Tuesday March 21, 2023 @01:51PM (#35249797)
Simply untrue, legally and socially
Re:Adobe Firefly: AI Art Generator by krisoft on Tuesday March 21, 2023 @01:30PM (#35249487)
I'm not a lawyer and I don't work for Adobe. :)

The contributor agreement linked from here[1] is this: [2]

"You grant us a non-exclusive, worldwide, perpetual, fully-paid, and royalty-free license to use, reproduce, publicly display, publicly perform, distribute, index, translate, and modify the Work for the purposes of operating the Website; presenting, distributing, marketing, promoting, and licensing the Work to users; developing new features and services; archiving the Work; and protecting the Work. "

I guess this would fall under the "developing new features and services".

What is funny is that "we may compensate you at our discretion as described in section 5 (Payment) below". :) I like when I may be compensated :)

And in section 5 they say: "We will pay you as described in the pricing and payment details at [...] for any sales of licenses to Work, less any cancellations, returns, and refunds."

So yeah. Sucks to the artist who signed this. They can use your work to develop new features and services, and they do not have to pay you for that at all, since it is not a sale of a license.

1: https://helpx.adobe.com/stock/contributor/help/submission-gu...

2: https://wwwimages2.adobe.com/content/dam/cc/en/legal/service...

Re:Adobe Firefly: AI Art Generator by roughly on Tuesday March 21, 2023 @02:46PM (#35250645)
> They can use your work to develop new features and services, and they do not have to pay you for that at all, since it is not a sale of a license.

And in this case, to develop new features and services that specifically undercuts your existing business, viz. selling stock photos for money. Sucks to the artists, indeed.

Re:Adobe Firefly: AI Art Generator by pradn on Tuesday March 21, 2023 @04:45PM (#35252261)
The terms seem like legalese for "you pay me money now and get to do anything with it". It doesn't seem far-fetched for training AI models to be a valid use-case. This is way better than scraping the whole internet, for art by artists who have had no commercial arrangement with Adobe.
Re:Adobe Firefly: AI Art Generator by wwweston on Tuesday March 21, 2023 @05:14PM (#35252668)
I'm starting to think that use of works in a training set is a category not covered well by existing copyright law, and it may be important to require separate explicit opt-in agreement by law (and receipt of some consideration in return) in order to be considered legitimate use.

The vast majority of copyrighted works were conceived and negotiated under conditions where ML reproduction capabilities didn't exist and nobody knew what related value they were negotiating away or buying.

Re:Adobe Firefly: AI Art Generator by musicale on Tuesday March 21, 2023 @05:45PM (#35253022)
Derivative works or remixes usually require a license. Artists could very reasonably argue that AI-generated images are derivative works from their own images - especially if there is notable similarity or portions appear to be copied. They could also point out that their images were used for commercial purposes without permission and without compensation to generate works that compete with their own.

For example, even a short sample used in a song usually has to be licensed. Cover versions of songs may qualify for a compulsory license with a set royalty payment scale.

However some reuse (such as transformative use, parodies, or use of snippets for various purposes, especially non-commercial purposes) may be considered fair use. AI companies could very reasonably argue that use of images for training AI models is transformative and qualifies as fair use, that no components of the original images are reused in AI-generated images, and that AI-generated images are no more infringing than human-generated images which show influences from other artists.

Absent additional law, I expect the legal system will have to sort out whether AI-generated images infringe the copyright of their training images, and if so what sort of licensing would be appropriate for AI-generated (or other software/machine-generated) images based on training data from images that are under copyright.

Re:Adobe Firefly: AI Art Generator by AJ007 on Tuesday March 21, 2023 @06:25PM (#35253549)
I propose that it is impossible to prove that any content created after 2022 did or did not utilize ML/AI during the process of its creation (art, code, music, audio, text.) Thus, anything produced after 2022 should not be eligible for copyright protection. Everything pre-2022 may retain the existing copyright protection but should be subject to extra taxes on royalties and fees given the exorbitant privilege.

Though this sounds extreme, enforcing the alternative would break any last remnant of human privacy. It would kill the independent operation of computing as we know it and severely cripple AI/ML research when we need it most: human alignment.

It is possible that a catastrophic event occurs and halts the supply chain of advanced semiconductors in the near future, in which case the debate can be postponed indefinitely.

Re:Adobe Firefly: AI Art Generator by wwweston on Wednesday March 22, 2023 @01:58AM (#35257345)
> AI companies could very reasonably argue that use of images for training AI models is transformative and qualifies as fair use

Yep. They could. And people do.

But this particular use is entirely new, though. Old conceptions of fair use can't and shouldn't cover it. "Transformative"? Sure, but there's a difference between transforming a work once and laying hold of it in automation to be transformed on request millions or billions of times in degrees ranging from simple to convoluted. It's hard to argue that the right to this exists in fair use when awareness of the possibility didn't exist when fair use conceptions were constructed.

The output isn't the issue so much as the consent & consideration for use of the input. We'll need case law or statutory law that understands this. It should be possible, but it should be possible on an opt-in basis. When you're training a model, you should know.

> AI-generated images are no more infringing than human-generated images which show influences from other artists.

If we end up with a policy differentiating the two and privileging humans and works created by them, I'm fine with that.

Re:Adobe Firefly: AI Art Generator by novok on Tuesday March 21, 2023 @06:11PM (#35253365)
If this kind of abstract copyright regime of 'I had the idea first, and anyone who uses a derivative of my idea must pay me money!' is a very sillpery slope of anyone who makes art or music of any genre needing to pay a royalty to sony/disney, because that is where these 'flavor copyrights' will end up going. The right kind of ambitious amoral lawyer in a common law regime will leverage an AI royalty law into a generic style copyright law because that is what will be needed to write this law properly.

And on top of that, it will become a spotify where each creator gets a sum total of $0.00000000001 per AI their media item was trained on and maybe a few dollars a month, while paying a greater tax to apple-sony-disney whenever their AI style recognizers charge you a royalty bill for using whatever bullshit styles it notices in your media items.

Copyright should stay in it's 'exact duplication' box, lest we release an even worse intellectual property monster on the world.

Re:Adobe Firefly: AI Art Generator by wwweston on Thursday March 23, 2023 @12:42AM (#35270621)
> If this kind of abstract copyright regime of 'I had the idea first, and anyone who uses a derivative of my idea must pay me money!' is a very sillpery slope

This is a cartoon conception of both existing copyright and the proposal I described.

Copyright applies to works, not "ideas" (William Gibson doesn't have a copyright claim on the "idea" of a virtual reality but he does on _Neuromancer_ as a work). It gives creators incentives and a stake in their work by allowing for some degree of control in how works are used and especially how they're distributed.

What I'm proposing isn't that different, and it's simple:

People should be able to decide if their work is put into a training set, and what they get in return for it.

That's it. No "flavor copyrights." No ownership of ideas. Just a claim on the creator's work and how it's used/ distributed. Specifically updated to cover a case that didn't exist 10 years ago, a case whose explicit intention is reproduction of not just one narrow aspect of the work but a combinatorially large number of aspects of the work (there's no other reason for adding it to the training set, that's the nature of these models).

> it will become a spotify where each creator gets a sum total of $0.00000000001 per AI their media item was trained on

"the artists will get such a small payout so we should make sure they get nothing" is quite the take.

I think "artists should be able to negotiate what consideration they want in return for their work for a training set" is a better one. It's certainly better than "people collecting training data should be able to take anything they can get their digital hands on without any consideration other than possession." Maybe some artists would take a nanocent per use. Maybe they wouldn't. That should be up to them.

Part of the reason why services like Spotify are so terrible economically is the way digital rights were assumed by labels and streamers often as extensions of older pre-digital conceptions without much in the way of negotiation by artists. The current moment is a chance to do better across an equally large (if not larger) technological shift.

Re:Adobe Firefly: AI Art Generator by cronix on Wednesday March 22, 2023 @12:40AM (#35256908)
That is basically the same boiler plate legal release for photography/videography/audio works in general. You sell me this thing, and I can do whatever I want with it.

From the popular Getty Images, used by media worldwide: > When a customer uses one of your files, it may appear in advertising, marketing, apps, websites, social media, TV and film, presentations, newspapers, magazines, books, or product packaging, among many other uses.

https://www.gettyimages.com/workwithus

Re:Adobe Firefly: AI Art Generator by unreal37 on Tuesday March 21, 2023 @02:17PM (#35250205)
Nobody owes creators who have been paid fully for their work "extra" compensation just because AI is involved. Assuming they have been paid, the work belongs to Adobe.
Re:Adobe Firefly: AI Art Generator by krisoft on Tuesday March 21, 2023 @02:24PM (#35250311)
> Assuming they have been paid

That is the question we are asking, yes. Based on the reading of the contributor agreement it sounds like Adobe doesn’t have to pay a cent to the creators to train models on their work.

Does that sound fair to you?

Re:Adobe Firefly: AI Art Generator by flangola7 on Tuesday March 21, 2023 @02:28PM (#35250381)
ChatGPT trained on my GitHub code and I wasn't paid anything at all. Is that preferable?
Re:Adobe Firefly: AI Art Generator by ClumsyPilot on Tuesday March 21, 2023 @02:55PM (#35250800)
"Since someone screwed me, they should screw you"? Crab bucket mentality?
Re:Adobe Firefly: AI Art Generator by flangola7 on Tuesday March 21, 2023 @08:37PM (#35255021)
No one is screwing anyone. I also learned from reading GitHub code and continue to do so. I haven't "screwed" the original code authors by forming an abstract memory of their code.

Any country that tries to forbid this will be torpedoing their economic competitiveness against countries that allow it.

Re:Adobe Firefly: AI Art Generator by xbar on Tuesday March 21, 2023 @11:25PM (#35256427)
This is a common fallacious argument.
Re:Adobe Firefly: AI Art Generator by flangola7 on Wednesday March 22, 2023 @06:21PM (#35267828)
What is "this" ?
Re:Adobe Firefly: AI Art Generator by krisoft on Tuesday March 21, 2023 @03:18PM (#35251152)
> Is that preferable?

I don’t see why you are asking this. Which part of my comment made you think it is preferable?

Re:Adobe Firefly: AI Art Generator by jacobr1 on Tuesday March 21, 2023 @03:56PM (#35251652)
It might also be wrong, yes. I have plenty of code licensed under very permissive licenses that still requires attribution. It is an open question of how much the AI system is a "derived" work in a specific, technical sense. And it probably will remain hard, since the answer is probably on a continuum.
Re:Adobe Firefly: AI Art Generator by irrational on Tuesday March 21, 2023 @02:48PM (#35250673)
If they signed the contract, then yes.
Re:Adobe Firefly: AI Art Generator by yoden on Tuesday March 21, 2023 @02:48PM (#35250685)
The creators of these images assigned the rights to adobe, including allowing Adobe to develop future products using the images. So yes, this is perfectly fair.

It's completely different than many (most?) other companies, which are training on data they don't have the right to re-distribute.

Re:Adobe Firefly: AI Art Generator by krisoft on Tuesday March 21, 2023 @03:13PM (#35251062)
> So yes, this is perfectly fair.

I think you are making a jump here. I’m not a lawyer, but your first sentence seems to be about why it is legal. And then you conclude that that is why it is also fair. I’m with you on the first one, but not sure on the second.

The creators uploaded their images so adobe can sell licences for them and they get a share of the licence fees. Just a year ago if you asked almost any people what “using the images to develop new products and services” mean they would have told you something like these examples: Adobe can use the images in internal mockups if they are developing a new ipad app to sell the licences, or perhaps a new website where you can order a t-shirt print of them.

The real test of fairness I think is to imagine what would have happened if Adobe ring the doorbell of any of the creators and asked them if they can use their images to copy their unique style to generate new images. Probably most creators would have agreed on a price. Maybe a few thousand dollars? Maybe a few million? Do you think many would have agreed to do it for zero dollars? If not, then how could that be fair?

Re:Adobe Firefly: AI Art Generator by gnopgnip on Tuesday March 21, 2023 @07:15PM (#35254143)
No that isn't how it works with Adobe or any of the other big stock photo companies. The photographers or creators of the images still own the copyright. Both with rights managed and royalty free they aren't assigning rights to anyone else.
Re:Adobe Firefly: AI Art Generator by krisoft on Wednesday March 22, 2023 @07:09AM (#35259346)
> Both with rights managed and royalty free they aren't assigning rights to anyone else.

Have you read the contributor agreement? That seems to contradict what you are saying.

Re:Adobe Firefly: AI Art Generator by gnopgnip on Friday March 24, 2023 @10:05PM (#35298418)
The word "assign" doesn't appear at all
Re:Adobe Firefly: AI Art Generator by stale2002 on Tuesday March 21, 2023 @02:53PM (#35250762)
And I am sure that you use your computer for work, to make money, and yet you based on the reading of the contributor agreement it sounds like [The computer buyer/you] doesn’t have to pay a cent to the [computer creator] for all the money you make using that computer.

Does that sound fair to you?

See how stupid that sounds?

Re:Adobe Firefly: AI Art Generator by TheOtherHobbes on Tuesday March 21, 2023 @03:07PM (#35250972)
It sounds stupid because it's a completely different thing.

A tool maker does not have a claim on the work made with a tool, except by (exceptionally rare) prior agreement.

Creative copyright explicitly does give creators a claim on derivative work made using their creative output.

That includes patents. If you use a computer protected by patents to create new items which specifically ignore those patents, see how far that gets you.

I expect you find this inconvenient, but it's how it works.

Re:Adobe Firefly: AI Art Generator by stale2002 on Tuesday March 21, 2023 @03:44PM (#35251503)
> Creative copyright explicitly does give creators a claim on derivative work made using their creative output.

No actually, not for this situation. They don't if they sold the right to do that, which they did.

> except by (exceptionally rare) prior agreement

Oh ok. So then, if in situation 1, and situation 2, there is the same exact prior agreement on the specific topic of if you are allowed to make derivative works, then the situations are exactly same.

Which is the situation.

So yes, the situations are the same, because of the same prior agreement.

Thats why the situation is stupid. The creator sold the rights to make derivative works away. Just like if someone sold you a computer.

And then people used the computer, and also used the sold rights to make derivatives works for the art, because both the computer and the right to make derivative works were equally sold.

> which specifically ignore those patents

Ok now imagine someone sells the rights to use the patent in any way that they want, and then you come along and say "Well, can you considered that if the person didn't sell the patent, that this would be illegal?"

That wouldn't make any sense to say that.

Re:Adobe Firefly: AI Art Generator by unreal37 on Tuesday March 21, 2023 @06:51PM (#35253846)
I don't know if there is a concept in copyright that prevents someone from viewing your work.

Like, if you created a lovely piece of art, hung it on the outside of your house, and I was walking on the sidewalk and viewed it. I would not owe you money and you would have no claim of copyright against me.

Copyright covers copying. Not viewing.

So an AI views your art, classifies it, does whatever magic it does to turn your art into a matrix of numbers. The model doesn't contain a copy of your art.

Of course, a court needs to decide this. But I can't see how allowing an AI model to view a picture constitutes making an illegal copy.

Re:Adobe Firefly: AI Art Generator by dragonwriter on Tuesday March 21, 2023 @06:53PM (#35253869)
> Of course, a court needs to decide this. But I can’t see how allowing an AI model to view a picture constitutes making an illegal copy.

Memory involves making a copy, and copies anywhere except in the human brain are within the scope of copyright (but may fall into exceptions like Fair Use.)

Re:Adobe Firefly: AI Art Generator by darreninthenet on Tuesday March 21, 2023 @08:07PM (#35254702)
And this is where it becomes tricky as holding a copy in memory so software can "use" it being against copyright also prevents it being displayed on Adobe's website, or Adobe shrinking it to fit on advertising collage for Adobe Stock images etc, all of which the artist would say is fine as otherwise their work cannot be advertised for them to make money through Adobe's service.

Supposing the AI said "here's the picture you asked for, btw it's influenced most by these four artists and here's links to their works on Adobe Stock"... is that better (or worse)?

Re:Adobe Firefly: AI Art Generator by TheOtherHobbes on Tuesday March 21, 2023 @03:02PM (#35250893)
Some very strange responses in this sub-thread.

When the agreement was signed no one was even able to imagine their work being used for AI. As far as they knew they were signing a standard distribution agreement with one particular rights outlet, while reserving all other rights for more general use. If anyone had asked about automated use in AI it's very likely the answer would have been a clear "No."

It's predatory and very possibly unlawful to assume the original agreement wording grants that right automatically.

The existence of contract wording does not automatically imply the validity of that wording. Contracts can always be ruled excessive, predatory, and unlawful no matter what they say or who signed them.

Re:Adobe Firefly: AI Art Generator by krisoft on Tuesday March 21, 2023 @03:17PM (#35251120)
> If anyone had asked about automated use in AI it's very likely the answer would have been a clear "No."

Maybe. Maybe not. Very clearly there is a price point where it could be worth it for the artist. Like if adobe paid more for the rights than they recon they will ever earn in a lifetime or something. But clearly everybody would have said “no” at the great price point of 0 dollars.

Re:Adobe Firefly: AI Art Generator by webnrrd2k on Tuesday March 21, 2023 @03:47PM (#35251546)
I'm not sure it true that creators are owed nothing further... It seems analogous to a musician signing over rights for one thing, like recording rights on wax disks, records or whatever. Then along comes radio, after the artists signed away a smaller set of rights. The radio companies claim that they owe the artists nothing. But is that true?

And that's a different question from whether or not they deserve extra compensation. Is it moral or ethical to use their work to directly undercut them via ai 'copying' their work?

Re:Adobe Firefly: AI Art Generator by justinclift on Tuesday March 21, 2023 @06:39PM (#35253714)
Heh Heh Heh

Half the problems with music is because of record companies magically inventing new ways to try and extract more money from each other and their supply chain.

"Oh, your band looked at some hookers they passed on the way to the recording studio? Well, they obviously owe those hookers a cut of the royalties now for inspiration..."

Trying to use AI as an excuse to be paid a 2nd time (for previously fully paid works) seems like another attempt at rent seeking in a similar manner.

Re:Adobe Firefly: AI Art Generator by jacobr1 on Tuesday March 21, 2023 @03:51PM (#35251590)
The prior deal was based on royalties for use. Adobe pays you 33% percent of anything they make. It is consignment. So if someone uses a specific photo for $20, you get paid $6.60, no money us paid upfront.

So what should adobe pay you for using the data in training? Some kind of fraction of the overall revenue they generate from the new product? The license currently used for their stock program make it seem like they don't have to pay anything at all, because this use cases wasn't understood previously. Adobe reserved to rights to do it, so legally they can - but if they want to continue getting contributions they will need to figure out some kind of updated royalty sharing agreement.

Re:Adobe Firefly: AI Art Generator by ttjjtt on Tuesday March 21, 2023 @05:00PM (#35252488)
Defining how “fully” paid a creator has been is the entire point of license agreements. It defines the extent of how much the rights have been purchased away from them.

It merits investigation as to have these creators been “fully” paid to the extent that they have no claim to any future royalties and can have no objection to their work being used as training data.

Re:Adobe Firefly: AI Art Generator by easyThrowaway on Wednesday March 22, 2023 @05:24AM (#35258657)
Switch "creators" with "musicians" and "AI" with "streaming" and I we feel like we went back to early 2000. Same arguments.

Adapting what Steve Albini said at the time: If you're an artist, negotiate your future "AI training rights" separately. Make sure they're in writing. Make sure attribution rights stay yours.

Re:Adobe Firefly: AI Art Generator by mesh on Tuesday March 21, 2023 @02:24PM (#35250298)
We are working on a compensation model for Stock contributors for the training content, and will have more details by the time we release.

The training is based on the licensing agreement for Adobe contributors for Adobe Stock.

(I work for Adobe)

Re:Adobe Firefly: AI Art Generator by egypturnash on Tuesday March 21, 2023 @02:31PM (#35250423)
Thanks! I am delighted to know that Adobe's got plans on that front.
Re:Adobe Firefly: AI Art Generator by roughly on Tuesday March 21, 2023 @02:49PM (#35250695)
I would be very, very interested to see a compensation system that took into account the outputs of the trained model - as in, weights derived from your work are attributable to X% of the output of this system, and therefore you are due Y% of the revenue generated by it. It sounds like Adobe is taking seriously the question of artist compensation, and I'd love to see someone tackle the "Hard Problem" of actual attribution in these types of systems.
Re:Adobe Firefly: AI Art Generator by brookst on Tuesday March 21, 2023 @03:28PM (#35251275)
I've looked a few times, but have not seen any research on assigning provenance to the weights used in a particular inference run. It's a super interesting space for a bunch of reasons.

But the naive approach of having a table of how much each individual training item influenced every weight in the model seems impossibly big. For DALL-E 2's 6.5B parameters and 650m training items, that's 4.2 quadrillion associations. And then you have to figure out which weights contributed the most to an output.

I would love to see any research or even just thinking that anyone's done on this topic. It seems like it will be important in the future, but it also seems like a crazy difficult scale problem as models get bigger.

Re:Adobe Firefly: AI Art Generator by bash-j on Tuesday March 21, 2023 @04:03PM (#35251740)
Could you not use tags used to label the image? If your image contains more niche tags that match the user input, your revenue share will be higher. Depending how much extra people earn for certain tags, it might incentivise people to upload more images of what is missing from the training data.
Re:Adobe Firefly: AI Art Generator by brookst on Tuesday March 21, 2023 @04:20PM (#35251959)
That's interesting, but I'm not sure it works. I think that works out to "for any given prompt, distribute credit to every source image that has a keyword that appears in the prompt, proportional to how many other source images had that same keyword".

If I include the tag "floor", do I get some (tiny) percentage of every image that uses "floor" in the prompt, even if the bits from my image did not end up affecting model weights much at all in training?

Worse, for tags like "dramatic lighting", it's likely that the important source images will depend on the other words in the prompt; "sunset, dramatic lighting" will probably not use the rely on the same weights or source images as "theater interior, dramatic lighting".

And then you get the perverse incentives to tag every image with every possible tag :)

I'd love to be convinced otherwise, but I'm not seeing prompt-to-tag association working.

Re:Adobe Firefly: AI Art Generator by bash-j on Tuesday March 21, 2023 @06:53PM (#35253863)
The tags could be added by a model rather than the user submitting the image. Maybe do both and verify the tags with a model? Users could get a rating based on how reliably they tag their pictures and are trusted to add more niche tags at higher ratings. You could even help tag other pictures to improve your rating.
Re:Adobe Firefly: AI Art Generator by gradys on Tuesday March 21, 2023 @04:26PM (#35252012)
https://arxiv.org/abs/1703.04730

> How can we explain the predictions of a black-box model? In this paper, we use influence functions -- a classic technique from robust statistics -- to trace a model's prediction through the learning algorithm and back to its training data, thereby identifying training points most responsible for a given prediction.

Re:Adobe Firefly: AI Art Generator by brookst on Tuesday March 21, 2023 @04:32PM (#35252104)
Oh thank you! Will go read and digest.
Re:Adobe Firefly: AI Art Generator by batch12 on Tuesday March 21, 2023 @08:37PM (#35255020)
This would be an interesting way to distill/finetune a model by finding the optimal minimum corpus needed to match a given use case.
Re:Adobe Firefly: AI Art Generator by natch on Tuesday March 21, 2023 @08:51PM (#35255143)
> And then you have to figure out which weights contributed the most to an output.

Why do you have to, though? What do you hope to trace back to exactly?

Re:Adobe Firefly: AI Art Generator by brookst on Wednesday March 22, 2023 @09:08AM (#35260422)
The business problem is “which items from the training corpus contributes the most to this inference”
Re:Adobe Firefly: AI Art Generator by astrange on Tuesday March 21, 2023 @06:08PM (#35253317)
That is impossible. You might be able to do it if you invented a completely different method of image generation, but the amount of original images present in a diffusion model is 0% with reasonable training precautions, and attributing its weights to particularly any of its input is nearly arbitrary.

(Also, it's entirely possible that eg a model could generate images resembling your work without "seeing" any of your work and only reading a museum website describing some of it. Resemblance is in the eye of the beholder.)

Re:Adobe Firefly: AI Art Generator by jamilton on Tuesday March 21, 2023 @06:38PM (#35253692)
I think the naive approach of just dividing revenue equally across all contributors could be acceptable, and would have lower overhead costs.
Re:Adobe Firefly: AI Art Generator by pabs3 on Tuesday March 21, 2023 @09:28PM (#35255495)
What about the openly licensed content you mentioned above?
Re:Adobe Firefly: AI Art Generator by easyThrowaway on Wednesday March 22, 2023 @05:16AM (#35258613)
Hope I can get better rates from this compared than those offered by Spotify to my musician friends. How much are we talking about? 0.00001¢ per licensed generated image?