News for hackers. Stuff that matters.

A comment on ControlNET and Stable Diffusion: A Game Changer for AI Image Generation. Parent comment

Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by Syntonicles on Sunday February 19, 2023 @11:51PM (#34865019)
You've convinced me to go for it. I'm downloading the models from HuggingFace and the source from Github.

I'm not sure how it all fits together but I'll try to figure it out. I have experience with Python development, git LFS, and I've been following research papers for years but this is my first attempt.

Is this all self-contained? Should I start elsewhere? I've been pretty intimidated by this stuff TBH, relying on hosted Midjourney / Dall-E for my artwork.

I notice the two repos have the same name. Do I merge the file-trees? How do they work together?

[ Parent | on HN ]
Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by zone411 on Monday February 20, 2023 @12:18AM (#34865163)
You could first see if you like it using https://huggingface.co/spaces/hysts/ControlNet. I quickly made these https://twitter.com/LechMazur/status/1626668677473918981
[ Parent | on HN ]
Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by Syntonicles on Monday February 20, 2023 @12:37AM (#34865271)
Thank you, I'm new to the site and didn't know about spaces. I'm more interested in trying to run a model locally. All I've ever used locally are toy implementations, and 20-line DQN experiments that never seemed to converge.
[ Parent | on HN ]
Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by zone411 on Monday February 20, 2023 @01:04AM (#34865423)
If you want to run it locally, the Automatic1111 repo that was mentioned does have most up-to-date models, but it's also messy and breaks often. But is your GPU up to the task?
[ Parent | on HN ]
Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by Syntonicles on Monday February 20, 2023 @02:21AM (#34865858)
Yes.
[ Parent | on HN ]
Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by SV_BubbleTime on Monday February 20, 2023 @06:14PM (#34874192)
That's a fair recommendation, but I think there is a massive difference when you have offline-hands-on compared to this. At first, it's all iterations, which at it's fastest, huggingface won't be able to do. It's fair to try, but I think you really need hands on local.
[ Parent | on HN ]
Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by belltaco on Monday February 20, 2023 @12:00AM (#34865075)
I would say start with this

https://github.com/AUTOMATIC1111/stable-diffusion-webui

And then this https://www.reddit.com/r/StableDiffusion/comments/1167j0a/a_...

Step by step video tutorial https://youtu.be/vhqqmkTBMlU

[ Parent | on HN ]
Re:ControlNET and Stable Diffusion: A Game Changer for AI Im... by Syntonicles on Monday February 20, 2023 @12:40AM (#34865282)
Excellent, thank you!
[ Parent | on HN ]