News for hackers. Stuff that matters.
Re:Adobe Firefly vs. MidJourney AI image generation by jamilton on Monday April 03, 2023 @03:09PM (#35429611)
It's interesting that the outputs still vaguely resemble the subjects of the prompts. It implies to me that there's still a little bit of the characters in the dataset, but not very much.

If you look up "Pikachu" in Adobe Stock [1] there actually are a lot of results. They're mostly figurines, pokemon cards, quokka, and Machu Pichu. Very few direct illustrations. And of course there might be filtering used on the dataset before it was used to train the model, a lot of the images that have Pokemon imagery are marked "Editorial use only".

1: https://stock.adobe.com/search?filters%5Bcontent_type%3Aphot...

Re:Adobe Firefly vs. MidJourney AI image generation by millimeterman on Monday April 03, 2023 @07:35PM (#35432952)
My uninformed speculation is that this might be an artifact of the embedding layer (e.g. CLIP), not the image training data.

Presumably, the dataset for training the embedding layer (which is trained separately and then fixed) is not stripped of copyrighted content. So it will have learned the "Pikachu" is related to words such as "yellow" and "rat".

Therefore, even if the image dataset didn't have a single picture of Pikachu, the image generator will still likely produce a yellow rat. Just one that doesn't actually resemble Pikachu.

Re:Adobe Firefly vs. MidJourney AI image generation by jamilton on Tuesday April 04, 2023 @12:45AM (#35435185)
That seems plausible to me. I assume if Adobe felt like even these results were too legally risky they could create a new embedding layer with fewer copyrighted concepts (so Deadpool would always output a spooky looking pool). I don't think that's likely though.
Re:Adobe Firefly vs. MidJourney AI image generation by sangnoir on Monday April 03, 2023 @09:11PM (#35433681)
> It implies to me that there's still a little bit of the characters in the dataset, but not very much.

I suspect there are a lot of the characters in the training data, but (postulating) there might be a post-generation adversarial selection step where anything that is recognizable as a someone else's IP gets filtered out of the results, so anything sufficiently Pikachu-like won't be shown, leaving behind the vague yellow monsters.

Re:Adobe Firefly vs. MidJourney AI image generation by jamilton on Tuesday April 04, 2023 @12:39AM (#35435157)
I would think attempting to filter it out after generation would be harder and less effective.
Re:Adobe Firefly vs. MidJourney AI image generation by sangnoir on Wednesday April 05, 2023 @03:16AM (#35450487)
ML image recognition predates diffusion models and is more mature - I'd be shocked if it's not employed in some form.

Such a system would be more robust against incidental infringement of IP not mentioned in the prompt. e.g. A prompt for "Theme park" won't create Mickey Mouse in the background