The method shown in this demo was already simple enough to teach someone to do in an afternoon. But we're only a week into the release of SD and we haven't gotten to all the sure-to-come GUIs that will pack the model into an idiot-proof application.

Think about it, give the user a few basic, MS-Paint level pencil tools, colors, shape makers. Ask for a description, the application can even push you in the right direction for putting together good, detailed prompts, gives you a list of art-styles, artists, filtering methods, etc all with reference images so you don't need to memorize names. You can zoom into sections of the image to work on independently (like the birds in the article), then blend it into the greater image. Drag and drop image files onto the project and iterate on them.

Implementing the glue to simplify the "tough" parts of this process is honestly pretty trivial.

The parts that are inaccessible right now seem incredibly easy to overcome.

Using a CLI-based tool is inaccessible for most people... but building a GUI around this would be very easy. I'm too lazy to google it, but I would bet someone already has a GUI, or is working on one.

12GB of VRAM may not be accessible on most computers, but there's nothing innovative about offloading that task to an EC2 instance. It just requires an opportunistic developer to tie the pieces together.

I would be monumentally surprised if Figma/Canva/InVision/Adobe are not already working on this.

If you're on windows and have a GPU, there's a GUI you can install. https://www.reddit.com/r/StableDiffusion/comments/x1hp4u/my_...

There's a WebUI with a docker container if you're on Linux w/ GPU; https://github.com/AbdBarho/stable-diffusion-webui and https://github.com/AbdBarho/stable-diffusion-webui-docker.

If you don't have a GPU, there's a Colab UI (Google hosted GPU). https://github.com/pinilpypinilpy/sd-webui-colab-simplified

> Using a CLI-based tool is inaccessible for most people...

CLI-based tools are perfectly accessible to most people.

They just can't be arsed to learn them, unless they need to. And most of the time, they don't, because good-enough alternatives exist.

If a CLI-based tool is the only way that an average person can get their work done, that's what they'll use.

> Plus, how many regular people have access to the machine with 12GB of VRAM?

Probably not many in general, but the RTX 3060 has 12GB or ram and it is around $350. And I saw a RTX 2060 12GB for $250 the other day. That's a pretty reasonable entry fee IMO.

Much less than what photoshop costed back in the day.

Few have those high end cards, but they don't need to anymore. Huggingface is saying it needs 12gb, but the source was forked with some smart mods to chunk the loading on to the GPU.

Itll comfortably run on 6gb now. gtx1600 series cards need to run in full precision mode to produce output. The HLKY fork has improved the Gradio GUI and integrated realesrgan and gfpgan for those with beefier cards.

Someone else also figured out how to load and run it all on a CPU, so pretty much anyone can in theory run the model now.

There is an elaborate Colab notebook linked in the HLKY repo that seems to get more point and click user friendly every time i look at it. I think it even launches the gradio webui so you can use the Colab instance with a webui remotely.

You can run the model on your CPU quite easily, and a lot of people have access to 16gb machines - it's much slower, for sure (10minutes/50passes on my old gaming pc), but it's still much faster than drawing things of the same quality by hand.

It dropped the bar to the other side of the planet. There are so many people computer literate that can pull this off. You could pick 5 people off the street that can follow these instructions and 3 of them would. VS the old way, you would have to pull off 400 people off the street and you probably wouldn't get this result unless you got really lucky.

Pick 5 people at random you get one who doesn't know what a mouse is, 2 or 3 who can turn on the computer and maybe one who can get to the cli. Out of 400 people you will find more natural artists compared to someone who could install this even if they had the equipment

Let me update your heuristics on this. Computer mice are practically obsolete. People use cell phones, not computers. No one needs a cli to run stable diffusion because a mobile web interface was released on day one. 6.6 billion people have a smartphone which is 83% of the world’s population (including the infants). This is about the same number of people who are literate.

4 out of 5 people globally would be able to submit a stable diffusion prompt and view a result. Most would have no idea what the hell was going on or even why it was interesting.

> Most would have no idea what the hell was going on or even why it was interesting.

This is the funniest part to me, because so many people already think this is how digital art worked to begin with.

There are already web sites that will run the underlying models, requiring no installation.

The neat new applications that have taken over this site for the last couple days sometimes require CLI steps to install because they are in active development and it can be easier to experiment with something local. I'm sure they'll either be moved online or wrapped in nice installers over the next couple weeks.

They can use it from their phone or tablet.

> People without computer literacy and/or basic programming skills won't be able to pull this off.

Yet. This is a huge leap forward, to get more basic prompts generating things will be a much smaller leap IMO.