News for hackers. Stuff that matters.
Re:Easy Stable Diffusion XL in your device, offline by brucethemoose2 on Friday December 01, 2023 @12:18PM (#38489300)
I would highly recommend Fooocus to anyone who hasn't tried: https://github.com/lllyasviel/Fooocus

There are a bajillion local SD pipelines, but this one is, by far, the one with the highest quality output out-of-the-box, with short prompts. Its remarkable.

And thats because it integrates a bajillion SDXL augmentations that other UIs do not implement or enable by default. I've been using stable diffusion since 1.5 came out, and even having followed the space extensively, setting up an equivalent pipeline in ComfyUI (much less diffusers) would be a pain. Its like a "greatest hits and best defaults" for SDXL.

Re:Easy Stable Diffusion XL in your device, offline by neilv on Friday December 01, 2023 @03:47PM (#38492151)
Looks like the Web UI of the self-hosted install of Fooocus sells out the user to Google Tag Manager.

Can our entire field please realize that running this surveillance is a bad move, and just stop doing it.

Re:Easy Stable Diffusion XL in your device, offline by stoobs on Friday December 01, 2023 @07:43PM (#38494609)
I think that's coming from gradio?
Re:Easy Stable Diffusion XL in your device, offline by SV_BubbleTime on Friday December 01, 2023 @07:53PM (#38494674)
Probably, auto1111 does the same - but I agree with GP it shouldn’t be there.

If it isn’t explicitly surveillance, it could effectively be.

Re:Easy Stable Diffusion XL in your device, offline by stoobs on Friday December 01, 2023 @08:13PM (#38494785)
Yeah, it is, just need to set an env var of GRADIO_ANALYTICS_ENABLED=False to stop it - probably should be added into launch.py along with the other env vars being set at launch.
Re:Easy Stable Diffusion XL in your device, offline by calamari4065 on Friday December 01, 2023 @03:11PM (#38491637)
Is this at all usable on a CPU-only system with a ton of RAM?
Re:Easy Stable Diffusion XL in your device, offline by brucethemoose2 on Friday December 01, 2023 @04:00PM (#38492293)
Not really. There is a very fast LCM model preset now, but its still going to be painful.

SDXL in particular isn't one of those "compute light, bandwidth bound" models like llama (or Fooocus's own mini prompt expansion llm that in fact runs on the CPU).

There is a repo focused on CPU-only SD 1.5.

Re:Easy Stable Diffusion XL in your device, offline by calamari4065 on Friday December 01, 2023 @08:19PM (#38494829)
Yeah, llama runs acceptably on my server, but buying a GPU and setting it all up seems really unfun. Also much more expensive than my hobby budget
Re:Easy Stable Diffusion XL in your device, offline by brucethemoose2 on Friday December 01, 2023 @09:06PM (#38495155)
You don't need a big one, even an old 4GB GPU will massively accelerate the prompt ingestion.
Re:Easy Stable Diffusion XL in your device, offline by liuliu on Friday December 01, 2023 @12:26PM (#38489404)
Yeah, Fooocus is much better if you are going for the best local generated result. Lvmin puts all his energy into making beautiful pictures. Also it is GPL licensed, which is a + in my book.
Re:Easy Stable Diffusion XL in your device, offline by stoobs on Saturday December 02, 2023 @06:08PM (#38503141)
Eh, I messed around with it for a while - it's okay and good for beginners, but without much more effort you can get better results out of A1111 or ComfyUI
Re:Easy Stable Diffusion XL in your device, offline by pmarreck on Friday December 01, 2023 @12:45PM (#38489648)
Have to build it yourself on Mac, and we all know how "fun" building Python projects is
Re:Easy Stable Diffusion XL in your device, offline by jessepasley on Friday December 01, 2023 @02:59PM (#38491473)
Just spent about 10 minutes building it on MacBook Pro M1. I come with significant bias against Python projects, but getting Fooocus to run was very, very easy.
Re:Easy Stable Diffusion XL in your device, offline by pmarreck on Friday December 01, 2023 @04:45PM (#38492906)
That's good to know!
Re:Easy Stable Diffusion XL in your device, offline by pmarreck on Friday December 01, 2023 @07:21PM (#38494456)
I finally had a chance to set it up and yes, it works great!
Re:Easy Stable Diffusion XL in your device, offline by mrbmbzl on Friday December 01, 2023 @08:58PM (#38495097)
did you get fooocus to run on silicon mac with mps support? i cant get mps support running for the love of god - any help would be much appreciated from me (as well as the 20 or so people plus that are currently looking for a solution on github to achieve normal speed generation compared to the 15 minutes per image :)) thank you
Re:Easy Stable Diffusion XL in your device, offline by jmpavlec on Sunday December 03, 2023 @12:45AM (#38505135)
Mine takes about ~3 min per image, didn't do anything special. Left everything at default settings after my initial install (about 5 days ago). Not speedy but certainly not 15 min. Running on an M1 with 32gb ram.
Re:Easy Stable Diffusion XL in your device, offline by pmarreck on Sunday December 03, 2023 @09:04AM (#38507154)
I think so… it’s an M1 Max Macbook Pro and it takes about 2-3 mins per image. I followed all the prerequisites on their install for mac page
Re:Easy Stable Diffusion XL in your device, offline by rvz on Friday December 01, 2023 @12:37PM (#38489537)
Looks like a complete contraption to setup and looks very unpleasant to use at first glance when compared against Noiselith.

The hundreds of python scripts and having the user to touch the terminal shows why something like Noiselith should exist for normal users rather than developers or programmers.

I would rather take a packaged solution that just works over a bunch of scripts requiring a terminal.

Re:Easy Stable Diffusion XL in your device, offline by Liquix on Friday December 01, 2023 @12:59PM (#38489906)
installation/setup is dead simple. up and running in under 3 minutes:

git clone https://github.com/lllyasviel/Fooocus.git

cd Fooocus

pip3 install -r requirements_versions.txt

python3 entry_with_update.py

Re:Easy Stable Diffusion XL in your device, offline by Filligree on Friday December 01, 2023 @02:38PM (#38491194)
Let's see...

> pip3: command not found

Okay. I'll need to install it? What package might that be in, hmm. Moving on, I already know it's python.

> /usr not writeable

Guess I'll use sudo...

= = =

Obviously I know better than to do this, but very few people would. This is not 'dead simple'! It's only simple for Python programmers who are already familiar with the ecosystem.

Now, fortunately the actual documentation does say to use venv. That's still not 'dead simple'; you still need to understand the commands involved. There's definitely space for a prepackaged binary.

Re:Easy Stable Diffusion XL in your device, offline by pixl97 on Friday December 01, 2023 @02:50PM (#38491358)
The people that make software that does useful things, and the people that understand system security live on different planets. One day they'll meet each other and have a religious war.

This said, it's nice when developers attempt to detect the executable they need and warn what package is missing.

Re:Easy Stable Diffusion XL in your device, offline by brucethemoose2 on Friday December 01, 2023 @02:56PM (#38491438)
There are projects that set up "fat" Python executables or portable installs, but the problem in PyTorch ML projects is that the download would be many gigabytes.

Additionally, some package choices depend on hardware.

In the end, a lot of the more popular projects have "one click" scripts for auto installs, and there are some for Fooocus specifically, but the issue there is its not as visible as the main repo, and not necessarily something the dev wants to endorse.

Re:Easy Stable Diffusion XL in your device, offline by gerwim on Saturday December 02, 2023 @04:07AM (#38497222)
Depending on your platform, but if you read the readme, there’s a pre packaged release with Python embedded.
Re:Easy Stable Diffusion XL in your device, offline by zirgs on Friday December 01, 2023 @03:47PM (#38492149)
Or you can use Stability Matrix package manager.
Re:Easy Stable Diffusion XL in your device, offline by brucethemoose2 on Friday December 01, 2023 @04:18PM (#38492565)
Yeah, VoltaML is also another excellent choice in stabilty matrix.
Re:Easy Stable Diffusion XL in your device, offline by liuliu on Friday December 01, 2023 @12:42PM (#38489605)
You have to make trade-off in software development. Fooocus trades on the best picture rather than the most beautiful interface, and also simplicity in its use. I think it is a good trade-off given the technology is improving at breaking-neck speed.

Look, DiffusionBee is still maintained but still no SDXL support.

Anyone who bet that the technology is done and it is time to focus on the UI is making the wrong bet.

Re:Easy Stable Diffusion XL in your device, offline by rgbrgb on Friday December 01, 2023 @01:36PM (#38490455)
This project is really cool and I like the stated philosophy on the README. I think it's making the right trade-off in terms of setting useful defaults and not showing you 100 arcane settings. However, the installation is too hard. It's a student project and free so I'm not criticizing the author at all but I think it's a pretty fair and useful criticism of the software and likely a significant bottleneck to adoption.
Re:Easy Stable Diffusion XL in your device, offline by Tiberium on Friday December 01, 2023 @12:51PM (#38489768)
Huh? It has a really simple interface, much much much simpler than anything else that uses SD/SDXL locally. Installation is also simple for Windows/Linux, don't know about macOS.
Re:Easy Stable Diffusion XL in your device, offline by stavros on Friday December 01, 2023 @06:19PM (#38493939)
I was afraid of the Python setup (even though I'm a Python developer), but yep: Make the virtualenv, install the dependencies, done. This is amazing, the images it generates are immediately beautiful.

It does look bad that it bundles GTM, though, as a sibling commenter says.

Samples:

https://imgz.org/i9oicVqo/

https://imgz.org/i8Ur3WjW/

https://imgz.org/i5j6r6TZ/

Re:Easy Stable Diffusion XL in your device, offline by brucethemoose2 on Friday December 01, 2023 @09:03PM (#38495135)
Be sure to try the styles as well. Thats actually a seperate input than the prompt for SDXL, and most other UIs dont implement the style prompting.
Re:Easy Stable Diffusion XL in your device, offline by dragonwriter on Saturday December 02, 2023 @01:14AM (#38496395)
> Be sure to try the styles as well. Thats actually a seperate input than the prompt for SDXL.

No, its not.

There are two text encoders, but they aren't really “prompt” and “style” inputs.

> and most other UIs dont implement the style prompting.

Most UIs default mode of operation sends the same input to both text encoders, but at least comfy has nodes that support sending separate text to them. OTOH, while there may be some cases where sending different text to the two encoders helps in a predictable way, AFAIK most of the testing people has done has shown that optimal prompt adherence usually comes from sending the same to both.

Re:Easy Stable Diffusion XL in your device, offline by antman on Saturday December 02, 2023 @04:02AM (#38497187)
What are the two text encoders?
Re:Easy Stable Diffusion XL in your device, offline by dragonwriter on Saturday December 02, 2023 @04:37AM (#38497371)
OpenCLIP ViT-G and CLIP ViT-L. The latter is the same encoder used in SD 1.x, OpenCLIP ViT-H was used as the encoder in SD 2.x, and ViT-G is, as I understand it, a successor and improvement on ViT-H.
Re:Easy Stable Diffusion XL in your device, offline by brucethemoose2 on Saturday December 02, 2023 @01:47AM (#38496508)
Hmm well that was a massive misunderstanding on my part.
Re:Easy Stable Diffusion XL in your device, offline by dragonwriter on Saturday December 02, 2023 @04:47AM (#38497401)
I’m not sure the origin, but using ViT-L (the encoder shared with SD1. x) for what you might call the main prompt and ViT-G (the new SDXL encoder, and also a successor to the encoder used as the single encoder in SD 2.x) for a style prompt was a common idea shortly after SDXL launched, so its understandable.
Re:Easy Stable Diffusion XL in your device, offline by airesearch69 on Tuesday December 05, 2023 @02:27PM (#38535726)
i use the same. Any ideas where to find actually (not outdated) guides on how to create your own "modell" out of the most similiar picutures of my dream modell? want to use it further with the same face on it.

thanks for any tipp guys :)