You've convinced me to go for it. I'm downloading the models from HuggingFace and the source from Github.

I'm not sure how it all fits together but I'll try to figure it out. I have experience with Python development, git LFS, and I've been following research papers for years but this is my first attempt.

Is this all self-contained? Should I start elsewhere? I've been pretty intimidated by this stuff TBH, relying on hosted Midjourney / Dall-E for my artwork.

I notice the two repos have the same name. Do I merge the file-trees? How do they work together?

You could first see if you like it using https://huggingface.co/spaces/hysts/ControlNet. I quickly made these https://twitter.com/LechMazur/status/1626668677473918981

Thank you, I'm new to the site and didn't know about spaces. I'm more interested in trying to run a model locally. All I've ever used locally are toy implementations, and 20-line DQN experiments that never seemed to converge.

If you want to run it locally, the Automatic1111 repo that was mentioned does have most up-to-date models, but it's also messy and breaks often. But is your GPU up to the task?

Yes.

That's a fair recommendation, but I think there is a massive difference when you have offline-hands-on compared to this. At first, it's all iterations, which at it's fastest, huggingface won't be able to do. It's fair to try, but I think you really need hands on local.

I would say start with this

https://github.com/AUTOMATIC1111/stable-diffusion-webui

And then this https://www.reddit.com/r/StableDiffusion/comments/1167j0a/a_...

Step by step video tutorial https://youtu.be/vhqqmkTBMlU

Excellent, thank you!