It’s a very very fancy compression algorithm, but it still is one.
It’s easy for these models to produce very close images to the source material with the right short input.
The fact that people are writing prompts with named artists, and phrases such as "Trending on Artstation"- yeah, I'm not sure if you can just handwave that away.
I don’t see the moral significance of the former genres versus the latter
Also, even if the model didn’t come with knowledge of an existing artist someone could fine-tune it in, and it’s possible the model can learn about your art style without seeing any of your images anyway.
Others have alluded to this, but I'll make a larger claim: human artists actually are doing very little that is original. The styles, composition, and subjects are all derivative works. That means their "essence" can be recreated without them.
Another fascinating consideration, if artists names were excised from future models, either by law or by choice, the "mirror" artists (fake) could be the ones which become famous and the humans forgotten.
AI could become more generalized or there may be millions of models, doing specific things, strung together like with APIs. Either way, if an artist or trademark owner chooses some kind of explicit blocking, from the input side, it is possible that it would be the equivalent of your keyword censored from Google's index, Google Maps, Amazon, and so on. Disney? I don't recognize that word.
A few weeks before OpenAI made DALL-E 2 open, I went through a series of prompts using well known artists as a basis. Vermeer was one of them. It generated some pretty amazing works that were 'inspired' but not direct copies of Vermeer's works.
I started feeding the same prompts into StableDiffiusion (the HuggingFace online demo) and it output direct copies of Vermeer's works with minimal modifications.
Two examples: https://imgur.com/a/KAxmZCl
The original: https://en.wikipedia.org/wiki/Girl_with_a_Pearl_Earring#/med...
It's reproducing the folds in the headband, riffles in the clothing, etc. It's not just a "similar" reproduced image, it's clearly some minor variation on the original.
https://drop.qoid.us/vermeer.png
And, for a slightly different scenario, here's what I got for 'pikachu':
https://drop.qoid.us/pikachu.png
But I think this sort of thing is the exception rather than the rule (similar to Copilot regurgitating the text of software licenses). Girl with a Pearl Earring is so famous that there are countless copies of it on the internet. I don't know what kind of deduplication process was used for Stable Diffusion, but if you consider multiple photos of the same painting, plus images distorted by compression, or cropped, or embedded in other images, plus attempts to redraw it or even parody it, I can easily imagine that the training set contained thousands of images or more that are essentially the same work. And so the model memorized it, albeit at low resolution.
Similarly, it's seen countless different images of Pikachu.
However, this seems to only apply to the very peak of popularity. I tested some other Pokemon: it does a decent job with Charizard, but with Bulbasaur and Squirtle and Jigglypuff its output only somewhat resembles the character design, and for less popular Pokemon there's no resemblance at all.
I think that's part of the point, though.
Even if it's working like some kind of feature detection - "this is what 'nose' looks like [nose1,nose2,...,nose9999]" and "this is what 'girl with a pearl earring vermeer' looks like [vermeer1,vermeer2,...,]"
Clearly it is storing copies of those images internally, and constant re-enforcement of it finding noses and vermeer paintings in the sources pushes the priority of those features up so that it stores them.
We can't trust these models, as they exist right now, to reliably generate new works, rather than spit out something that already exists.
There’s a difference between an artist and a machine (for now), but it’s not unreasonable to assume that some internalisation of others’ work is fair.
I didn't claim that it was storing all of the images.
It is, however, quite clearly storing at least some of the original training images. What that definition is, I don't know.
To go back to the original point of this thread:
> The thing is, people have wild misconceptions about what this technology does. Many clearly think it's a photocopier. As if StableDiffusion is hiding copies of all these works inside.
I don't think it's a wild misconception, or even an unreasonable concern to be worried that it could output some of it's training images. As an end-user of the technology, you have no idea.
There's different sorts of art for different purposes (commercial, fine, etc.), and for many of these sorts of art having an AI make it would be acceptable.
But when I think "art" without a qualifier, I think "fine art". And the purpose of fine art, for me, is human communication of ephemeral things that aren't possible to communicate in language.
I don't want AI generated fine art because it turns the art into just a pretty picture. It's no longer about another person communicating something significant and human to me. It removes its purpose for existing.
In that view, I totally understand why some art communities would ban AI-generated art. I don't see a problem with it. I'm sure other communities will not ban such art. That's fine, too.
But I know which community I would be more interested in paying attention to.
There is a person thinking about the prompt, typing in the prompt, painstakingly selecting the image that matches what they imagined in their head.
It just less elitist, as now even a child can create a complex, meaningful and beautiful images by leveraging the essence of human art (compressed into a single ML model).
I, for one, never had the time & chance to learn painting. Even if I did it as a hobby, it would take me up to a decade to become proficient at it.
And now I can ask AI to paint what I dreamt about last night (!!!), or create an impressionist painting almost exactly like I see it (or even better).
Fun factor is also there: I can see how an anime character could look in real life, or put a movie character in a new context , or just generate cute corgis wearing funny hats and driving cars
Which does make this a type of art. It just isn't the same form of art as digital painting, the same way painting a tree is not the same type of art as growing and 100 trees, choosing one of them and taking a photograph of it. Photography is definitely an art-form, but it's a different art-form from digital painting, even if the end result of the both of them can be a digital image. Not better or worse, but definitely different.
True, which makes it more akin to photography. I'm not saying it's "not art" (I'm saying the exact opposite of that), but that it's not art that is of interest to me. Much like my interest in art photography is very limited. Different people have different tastes.
> It just less elitist
I disagree. I think this whole subject is orthogonal to the concept of elitism. Sure, there are certainly art snobs who take an elitist perspective, but they're a very small segment of the art world.
And there we should just ask our new creative oracle machines the obvious: "devise an understandable minimally invasive method of uplifting our own cognition and extending our biological lifespan". Surely at least some gene/cell/whatever therapy which does what we need is theoretically possible - the human beings aren't special enough for this not to be the case.
At least that's the zeitgeist I perceive among others who understand the significance of the unfolding progress.
Why should we pay taxes, if the government won't even train AI for us, given such opportunity?
Large language models trained on cross-entropy loss for next token prediction aren't going to be dangerous per se, even in the limit - simply due to the nature of the objective and the distribution they are set to approximate.
We should make sure these powerful tools don't fall into a small exclusive set of power-hungry interests, though. Transformative tools such as these should benefit all of humanity and let it prosper.
An AGI, by virtue of being at least as general as a human, would be able to effectively form a plan for how to act in the world to achieve fairly general goals, in fairly general conditions.
Even if it isn’t agentic, if a program can formulate these plans in a way people can use, then the combined program+user still implements the optimization process.
The democratic solution here looks better than the expected rule of the (very) few.
Image generating AIs are trained with massive amounts of images and text, however image generating humans train with much broader spectrum of experience.
Also, feeding a model tons of images created by humans (directly or by proxy) and claiming that AI is generating something completely new is a bit naive IMHO. Humans mix a much more broader and deeper experience pool to create things without prompts.
An AI model blurts out something derived from a corpus of images and text created by humans, that's all.
The technology is impressive for sure, and it marks a new era in terms of possibilities, but it doesn't take my breath away, sorry.
The AI emulates. Humans create. - The significance here is not trivial.
I've seen lots of human-made art (especially on Artstation) that failed to elicit any emotional response in me.
The reason people are having this discussion is a fear of AI creating aesthetically pleasing and deep emotionally through statistical approach.
And the deeper fear that AI can potentially "hack" our senses by providing us with exactly what we want to see, read or hear (statistically).
i.e. if some subset of art is pushing our biological buttons more than all other art, and the effect is generalizable over human population, what would that say about us?
To better illustrate that difference: Just because anecdotally some human might produce crap doesn't mean that is the limit of all humans.
So you can imagine new colors?
That wide variety of experience changes the decision of what to create, but I think it has less influence on the actual output than one might expect. A person can have enormous life experience but if they have never seen a logo, a photo, a painting, a drawing, or any other kind of rendered image they will be no more sophisticated in their artistic output than a caveman. Modern artists stand atop a mountain that their ancestors had to climb inch by inch.
I want my photos to make the viewer feel a particular way when viewing what I took. This affects colors, style, and everything.
Arguably, as long as the medium carries the message the creator intended, it's equal in my view. It can be a photo, a drawing, a digital painting or a physical painting with oils. They can create the same feeling if the artist aims for it.
This "optimization for feelings" is a result of my own non-photographic experiences. Sometimes a song, sometimes an event I went through, sometimes an art piece I saw on a medium I don't work.
From my understanding and observation, I saw that many artists work that way. They reflect their emotions in one domain (generally personal life) to another domain (the art they create). Also, there was a video which I fail to find over and over which shows how three designers got affected by the things they saw (and deliberately planted into their minds slowly) during a 20 minute car trip.
Yes, we're building upon this great mountain of experience and knowledge, yet our output is affected by what we experience in other parts of life, unrelated to the art we create.
Consider the following experiment: The music you listen changes your mood, your working speed, and what you feel; effectively changing how you operate and what you create. Exclude work from this, which is by definition something you have to do, unless you're literally dying.
Right, and what happens when you let that loop feedback to itself?
An asphalt road on every corner, so we build more asphalt roads, we design only what has been designed before. Amplify this thousands of time through computer generated design, the feedback loop is closed and unchanging. Unless your goal is actually to create an independent organism (different moral issue), you are creating sophisiticated feedback loops, not worthwhile content generation. Unless by content generation you mean endless remixing...which is not the same.
Sort of like changing the color of a 3d model and claiming it is a new race with new attributes, as is often done on the cheap e.g. in videogames.
I don't see how AI art is less new than the vast majority of human art. Both can create unique compositions that are still deeply rooted in patterns and principles thousands of years old.
> Humans mix a much more broader and deeper experience pool to create things without prompts.
AI does not have understanding, but it's stealing the underlying patterns that are the end result of that human experience.
OTOH, if the 2 bytes is an index into a larger corpus of collected works, the question becomes more interesting.
OTOH, if the corpus is an ensemble of other 2-byte objects...
It's only "easy" because bunch of people over years perfected every step of the process.
You can see that it has memorised all its training material very clearly in its ability to perform style transfer. You can ask it to geneate an image of Pikachu in the style of Vermeer. It can do that because it has memorised images of Pikachu and images by Vermeer in its weird compressed form and it can combine them by finding a point on a gradient between their representation in its memory.
If it didn't have memorised images of Pikachu, or images by Vermeer, how do you guess it could generate images of Pikachu or in the style of Vermeer? It's not magick.
Better analogy: suppose you take 10 pieces of A4 paper and scrunch them up into 10 separate balls. Now suppose you scrunch them all up together into one ball. One manifold, taking ten times less space.
In the same way, you don't need to store each pixel of each image separately, or in its own sub-space. Yes? It's really good compression, that's all.
In my latest series of tweets [1] I tried to argue that this is not the case in a less technical way, not sure if I was successful though. For anyone not fluent in Korean, my argument was as follows:
Stable Diffusion was trained with a data set composed of about 2.32 billion text-image pairs. The model itself by comparison weighs about 4 GB. If the model somehow stored those images (completely disregarding texts) in the compressed form, it would be less than 2 bytes (EDITED) per each image. Whoever downloaded an image from the internet can see this is absurd. In reality 4 GB of data is the juice extracted from the data set, and if you could actually recover an original image from it then the juice must have had a recognizable residue, which would be pretty undesirable.
[1] https://twitter.com/senokay/status/1565543214068600832