Easy Stable Diffusion XL in your device, offline

Re:Easy Stable Diffusion XL in your device, offline by rgbrgb on Friday December 01, 2023 @11:56AM (#38488974)

Just installed, this is very cool. Local AI is the future I want (and what I'm working on too). A few notes using it...

Pros:

- seems pretty self contained

- built in model installer works really well and helps you download anything from CivitAI (I installed https://civitai.com/models/183354/sdxl-ms-paint-portraits)

- image generation is high quality and stable

- shows intermediate steps during generation

Cons:

- downloads 6.94GB SDXL model file somewhere without asking or showing location/size. Just figured out you can find/modify the location in the settings.

- very slow on first generation as it loads the model, no record of how long generations take but I'd guess a couple minutes (m1 max macbook, 64GB)

- multiple user feedback modules (bottom left is very intrusive chat thing I'll never use + top right call for beta feedback)

- not open source like competitors

- runs 7 processes, idling at ~1GB RAM usage

- non-native UX on macOS, missing hotkeys you'd expect, help menu. electron app?

Overall 4/5 stars, would open again :)

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by philote on Friday December 01, 2023 @12:41PM (#38489589)

Another con is it only works on Silicon Macs.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by Vicinity9635 on Friday December 01, 2023 @03:04PM (#38491549)

Apple Silicon* I presume?

This could honestly be the excuse I need (want) to order an absolute beast of a macbook pro to replace my 2013 model.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by quitit on Friday December 01, 2023 @04:05PM (#38492394)

If it's just for hobby/interest work, then just a heads-up that even the 1st generation Apple Silicon will turn over about one image a second with SDXL Turbo. The M3s of course are quite a bit faster.

The performance gains in recent models and PyTorch are currently outpacing hardware advances by a significant margin, and there are still large amounts of low-hanging fruit in this regard.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by wayfinder on Friday December 01, 2023 @04:56PM (#38493029)

If you want an absolute beast, especially for this stuff, you probably want Intel + Nvidia. Apple Silicon is a beast in power efficiency but a top of the line M3 does not come close to the top of the line Intel + Nvidia combo.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by Vicinity9635 on Friday December 01, 2023 @05:04PM (#38493137)

Well this would just be the excuse. I'm typing this on a Ryzen 5950X w/32 GB of RAM and a 4090. So I guess I already have the beast?

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by NorwegianDude on Friday December 01, 2023 @06:25PM (#38494004)

I guess EPYC and a few H100s is the next big step, at a much higer price point...

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by cchance on Monday December 04, 2023 @10:43AM (#38518631)

Get M1 macbook, throw your ryzen with 4090 in a closet and use it as a remote API endpoint for comfyui lol

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by liuliu on Friday December 01, 2023 @12:25PM (#38489390)

You should check out Draw Things on macOS. It works well enough for SDXL on 8GiB macOS devices.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by rgbrgb on Friday December 01, 2023 @02:20PM (#38490971)

Thanks. Yeah I played with your app early on and just fired it up again to see the progress. Frankly I find the interface pretty intimidating but it is cool that you can easily stitch generations together.

Unsolicited UX recs:

- strongly recommend a default model. The list you give is crazy long. It kind of recommends SD 1.5 in the UI text below the picker but has the last one selected by default. Many of them are called the same thing (ironically the name is "Generic" lol).

- have the panel on the left closed by default or show a simplified view that I can expand to an "advanced" view. Consider sorting the left panel controls by how often I would want to edit them (personally I'm not going to touch the model but it is the first thing).

You are doing great work but I wouldn't underestimate the value of simplifying the interface for a first-time user. It seems to have a ton of features but I don't know what I should actually be paying attention to / adjusting.

Is there a business model attached to this or do you have a hypothesis for what one might look like?

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by liuliu on Friday December 01, 2023 @02:51PM (#38491371)

Agreed on UX feedback. It accumulated a lot of crufts from the old technologies to the new. This just echos my early feedback that co-iterating UI and the technology is difficult, you'd better pick the side you want to be on and there is only one correct side (and unfortunately, the current app is trying hard to be on both-side).

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by miles on Friday December 01, 2023 @12:46PM (#38489660)

Are you the developer by any chance? If so, it would be helpful to state it.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by liuliu on Friday December 01, 2023 @12:55PM (#38489838)

I am. I thought this is obvious. My statement is objective. I would go as far as: it is the only app works at 8GiB macOS devices with SDXL-family models.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by cellularmitosis on Friday December 01, 2023 @02:53PM (#38491395)

"You should check out this thing" has a very different implied context than "You should check out this thing I made". The first sounds like a recommendation from an enthusiastic user, not from the the author. Because of this, discovering that you are the author makes your recommendation feel deceptive.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by liuliu on Friday December 01, 2023 @04:42PM (#38492866)

I am sorry if you feel that way. I joined HN when it was a small tight-knit community without much of marketing presence. The "obvious" comment is more like "people know other people" kind of thing. I didn't try to deceive anyone to use the app (and why should I?).

If you feel this is unannounced self-promotion, yes, it is, and can be done better.

---

Also, for the "objective" comment, it meant to say "the original comment is still objective", not that you can be objective only by being a developer. Being a developer can obviously bias your opinion.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by givinguflac on Friday December 01, 2023 @06:17PM (#38493925)

I think it was obvious. That said, thank you so much for your labor of love! The app is amazing! Any plans for SDXL Turbo support?

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by liuliu on Friday December 01, 2023 @07:44PM (#38494615)

Should be in a few days. I asked Stability to clarify whether I can deliver weights through my Cloudflare bucket and whether qualifying as non-commercial is who runs the model, not who delivers the model.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by fragmede on Saturday December 02, 2023 @02:58AM (#38496836)

2008, when we both joined, was 15 years ago. In the interim, the userbase has grown. Most people aren't recognizable as the author of an app under discussion, so a simple "Developer here" is appreciated as it was not obvious to me.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by TheHumanist on Friday December 01, 2023 @04:22PM (#38492621)

What do you mean it was obvious? Only the developer could make that objective statement?

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by adamjc on Friday December 01, 2023 @01:54PM (#38490668)

How would that be obvious to anyone?

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by ProfessorLayton on Friday December 01, 2023 @04:41PM (#38492852)

Whoa, well let me just say thanks for the awesome app!! it's pretty entertaining to spin this up in situations where I don't have internet (Airplane, subway etc.)

I was also surprised on how well it ran on my iPhone 11 before I replaced it with a 15 pro.

(Let me know if you're looking for some Product Design help/advice, totally happy to contribute pro bono. No worries if not of course!)

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by vunderba on Friday December 01, 2023 @05:20PM (#38493306)

Nice app - but for future reference it is very much not obvious to any native English speaker. "You should check out X" sounds like a random recommendation.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by rcarmo on Saturday December 02, 2023 @07:27AM (#38498141)

Any plans for SD Turbo? Both base and XL models would be a great fit for a mobile device.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by heyyeah on Saturday December 02, 2023 @09:08AM (#38498699)

Draw Things is amazing. Great work and thanks for developing it!

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by drcongo on Monday December 04, 2023 @11:36AM (#38519401)

I've been generating stuff non-stop in Draw Things for a few days, it's very good. Agree with the comments elsewhere about the rather overwhelming UI, and I have only one feature request: let us input the number of images we want to generate - the 100 limit means I keep having to check if it's finished to restart it.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by mikae1 on Friday December 01, 2023 @03:28PM (#38491880)

> not open source like competitors

Who are the competitors?

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by quitit on Friday December 01, 2023 @04:00PM (#38492296)

DiffusionBee: AGPL-3.0 license (Native app)

InvokeAI: Apache license 2.0 (web-browser UI)

automatic1111: AGPL-3.0 license (web-browser UI)

ComfyUI:GPL-3.0 license (web-browser UI)

There's more, but I don't pay enough attention to it

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by mikae1 on Friday December 01, 2023 @04:04PM (#38492373)

Thanks! https://lmstudio.ai/ too. For the more technically inclined perhaps.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by dragonwriter on Friday December 01, 2023 @04:13PM (#38492487)

I don't think lmstudio is competes with Stable Diffusion frontends, even for the technically-inclined.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by 0xDEADFED5 on Friday December 01, 2023 @11:52PM (#38495995)

for people with Intel video cards (all 10 of us!) there's also SD.Next (automatic1111 fork): https://github.com/vladmandic/automatic

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by vunderba on Friday December 01, 2023 @05:22PM (#38493340)

I'd also recommend InvokeAI, an open source offering which has a very nice editable canvas and is very performant with diffusers.

https://github.com/invoke-ai/InvokeAI

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by UberFly on Friday December 01, 2023 @07:22PM (#38494465)

I just installed InvokeAI and wish I hadn't. It installs -so much- outside of its target directory. A1111 and ComfyUI are fairly self contained where you put them.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by demosthanos on Friday December 01, 2023 @10:31PM (#38495620)

It's all isolated in a single directory, though, right? I set it up ages ago, but my recollection is that it installs itself in ~/invoke on Linux and stays contained there.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by 8n4vidtmkvmk on Saturday December 02, 2023 @07:07PM (#38503495)

I like ComfyUI the most now but it's probably not the most beginner friendly. But has great features, is extensible, and you can build workflows that work for you and save them so you don't have to click a million times like Auto1111.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by sytelus on Friday December 01, 2023 @05:33PM (#38493472)

+1 for asking download location.

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by mtlmtlmtlmtl on Friday December 01, 2023 @07:59PM (#38494715)

Is that 1GB idle per process or total for all 7 processes?

[ Parent | on HN ]

Re:Easy Stable Diffusion XL in your device, offline by maxdaten on Friday December 01, 2023 @11:49PM (#38495981)

If you are interested in the tech-stack:

https://noiselith.notion.site/License-61290d5ed7ab4c918402fd...

So yes, it is an electron app with svelte, headless-ui, tailwindcss etc

[ Parent | on HN ]