Re:Show HN: SMS Interface for Stable Diffusion
by choxi on Friday September 02, 2022 @08:32PM
(#32697352)
Did you set up your own infrastructure? I’ve been looking for a Heroku-like service to deploy some of these GPU intensive models
[ Parent
| on HN ]
Re:Show HN: SMS Interface for Stable Diffusion
by searchableguy on Friday September 02, 2022 @09:06PM
(#32697537)
You can use https://replicate.ai for heroku like experience. It's very expensive though but they charge compute per second based on requests.
Otherwise, I recommend using runpod, lambda, etc for an order of magnitude of savings.
Crowd source services like vast.ai aren't reliable and barely less expensive than dedicated low cost providers.
Re:Show HN: SMS Interface for Stable Diffusion
by arthurcolle on Friday September 02, 2022 @11:18PM
(#32698313)
I could use an assist/pointers on running this better. Would love to chat since you seem to have some knowledge here. If you're game, feel free to contact me at my HN username at Google's email service. Cheers!
Re:Show HN: SMS Interface for Stable Diffusion
by yolo4553 on Saturday September 03, 2022 @08:03AM
(#32701002)
As mentioned in a sibling comment those services are relatively expensive.
If you don't mind ~30 minute one time setup you can get stable diffusion up and running incl. a nice webinterface on basically any cloud provider offering GPUs. I used https://rentry.org/GUItard as a guide and adopted it slightly for my needs.
As my desktop only has a RTX3060 I am renting a GPU instance on Genesis Cloud (billed by the minute and no cost while instance is stopped) using a RTX3090 with 24 GB of vram.
Re:Show HN: SMS Interface for Stable Diffusion
by arthurcolle on Sunday September 04, 2022 @04:17PM
(#32717255)
How long does 50 step inference take with the rtx3090?
Re:Show HN: SMS Interface for Stable Diffusion
by yolo4553 on Monday September 05, 2022 @01:52AM
(#32720994)
512x512 with k_lms is around 5s
Re:Show HN: SMS Interface for Stable Diffusion
by arthurcolle on Monday September 05, 2022 @06:14AM
(#32722576)
Nice, that's pretty fast