News for hackers. Stuff that matters.
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by lawlessone on Tuesday October 03, 2023 @11:18AM (#37753067)
This would be really cool to have running embedded in a digital photo frame or wall painting.
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by eigenvalue on Tuesday October 03, 2023 @11:30AM (#37753213)
Great idea, where every 10 hours or so it would refresh with a new image it created itself (perhaps based on a theme supplied by the user).
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by amelius on Tuesday October 03, 2023 @11:36AM (#37753296)
Not very environment-friendly, though.
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by nathanfig on Tuesday October 03, 2023 @11:44AM (#37753408)
2.5A 5V is not much power, and it would use considerably less when idling.
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by notjtrig on Tuesday October 03, 2023 @12:26PM (#37754068)
125 watt hours for a raspberry pi to generate an image in 10 hours compared to 7 watt hours for a 440W PC to run for 1 minute.
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by lawlessone on Tuesday October 03, 2023 @12:38PM (#37754211)
Is this for a regular Pi . The OP post is using a Pi Zero 2.

That is big though

Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by agilob on Tuesday October 03, 2023 @11:44AM (#37753424)
Dude, we are literally using single use plastic bottles to store water for a few weeks in them.
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by dopidopHN on Tuesday October 03, 2023 @12:40PM (#37754242)
[delayed]
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by amelius on Tuesday October 03, 2023 @12:56PM (#37754502)
We are literally using LED lighting because it saves energy over conventional light bulbs.

And now we're going to put a screen on the wall that we don't even look at 99% of the time?

Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by BHSPitMonkey on Tuesday October 03, 2023 @05:40PM (#37757950)
If we're doing one bad thing already, we may as well do a hundred!
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by lawlessone on Tuesday October 03, 2023 @11:45AM (#37753440)
Compared to what though?

I think it might be friendlier in some aspects than fetching an image from a server running the big the models.

And you don't have to worry about service disruptions or api keys

An e-ink display doing it should only use energy when refreshes. And you could minimize refreshes to once a day, week, etc

Less friendly than a photo of course.

Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by aftbit on Tuesday October 03, 2023 @12:01PM (#37753672)
Why do you say that? The energy usage of inference? I would guess that the embodied energy of the digital photo frame is probably higher.
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by numpad0 on Tuesday October 03, 2023 @12:13PM (#37753861)
That's where $1999 color E Ink display comes into play.
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by lawlessone on Tuesday October 03, 2023 @12:26PM (#37754063)
There are cheaper.. but it might require dithering..
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by naillo on Tuesday October 03, 2023 @12:37PM (#37754205)
Watch 5 seconds of a tv show with your big tv and you've spent that environmental cost
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by isoprophlex on Tuesday October 03, 2023 @12:13PM (#37753858)
I'm building exactly that with an eink display atm. Sadly, i can't seem to be able to build the XNNPACK stuff on my pi zero 2W in the repo...
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by chasd00 on Tuesday October 03, 2023 @01:07PM (#37754648)
that's an awesome idea, do you have a link to more information?
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by isoprophlex on Tuesday October 03, 2023 @01:29PM (#37754951)
Ill write it up once it's done and post here, if it gains traction you might see it haha.

In all seriousness I can give a brief overview:

- I'll probably offload the image generation to the 5 year old intel nuc I already have as a home automation server, comfyUI in CPU mode takes 20-30 mins for a generation. Ideally it's all self contained on the Pi but that might be beyond me, skill wise.

- prompts are composed by taking time of day, season, special occasions (birthdays, xmas etc); adding random subjects from a long manually curated list; then asking gpt4 to creatively remix the prompt for variety

- i have an inky impression 7.3 inch 7 color eink display and a raspberry zero stuck onto it. Right now it'll simply download new images from the NUC every once in a while

- i like wood and i dislike the jagged 3d printer aesthetic so I'll create a frame from laser cut plywood by designing some stackable svg shapes in inkscape and sending those to a laser cutter

It works right now, functionally.

Considering that I'm painstakingly writing this on a phone with a sleeping 3 week old baby on my chest it'll be while before i have the energy to make it look like something you'd hang on your wall

Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by ionwake on Tuesday October 03, 2023 @09:11PM (#37759716)
Sounds awesome what’s your Twitter ?
Re:Running Stable Diffusion XL 1.0 in 298MB of RAM by changelink on Wednesday October 04, 2023 @05:21AM (#37762777)
I've built this a while back, using a previous version that runs Stable Diffusion on a raspberry pi zero 2 w:

https://hackaday.com/2023/09/19/e-paper-news-feed-illustrate...

https://github.com/rvdveen/epaper-slow-generative-art/