News for hackers. Stuff that matters.
Re:Show HN: TattoosAI – AI-powered tattoo artist, using Stab... by geuis on Thursday September 08, 2022 @02:53AM (#32762127)
Hey Danny. I just got SD running on my Windows desktop last night and spent a few hours today finding out why it won't run on my 2020 MacBook Pro.

What does your setup look like? What steps did you take to stand this up as a service?

Re:Show HN: TattoosAI – AI-powered tattoo artist, using Stab... by dannypostma on Thursday September 08, 2022 @02:56AM (#32762150)
I rewrote this SDK (https://github.com/Stability-AI/stability-sdk) to Javascript and turned it into a Cloud Worker. Quite the challenge, but I got it to work eventually.
Re:Show HN: TattoosAI – AI-powered tattoo artist, using Stab... by richrichardsson on Thursday September 08, 2022 @04:34AM (#32762906)
The lstein fork [1] of the CompVis main repo is working on "Apple Silicon" based machines (and may work on Intel based too). It's not very fast though, ~3.5 minutes for 50 steps on my 16GB M1 Mini, whereas I understand that a 3080 can spit them out in the 30 second range. M<x> machines with higher GPU core count I would suppose are faster.

[1] https://github.com/lstein/stable-diffusion

Re:Show HN: TattoosAI – AI-powered tattoo artist, using Stab... by fragmede on Thursday September 08, 2022 @05:08AM (#32763124)
Intel Macs with AMD GPUs are supported by the MPS backend.
Re:Show HN: TattoosAI – AI-powered tattoo artist, using Stab... by geuis on Saturday September 10, 2022 @12:27AM (#32787798)
Hey you may not get this reply till much later but I'd love more info.

From my research in the last couple days, it only seems that PyTorch will work with AMD cards in combo with RocM, and RocM specifically isn't supporting older AMD gpus that you find on Mac laptops from just 2020.

Can you expand on what MPS is?

Re:Show HN: TattoosAI – AI-powered tattoo artist, using Stab... by fragmede on Saturday September 10, 2022 @02:11AM (#32788268)
MPS is Metal Performance Shaders which is Apple's MacOS libraries for ML workloads. The MPS libraries are only on MacOS, but support both Apple Silicon and AMD GPUs. This means that on MacOS, you specify the 'mps' backend to pytorch as the device instead of 'cuda' or 'cpu', and MacOS runs operations on whatever GPU is available, be it an M1 or an M2 or an AMD GPU.

https://developer.apple.com/documentation/metalperformancesh...

Re:Show HN: TattoosAI – AI-powered tattoo artist, using Stab... by richrichardsson on Thursday September 08, 2022 @07:34AM (#32764073)
Presumably they need > 10GB of VRAM though? I'm guessing my 2019 MBP with only 4GB is going to say no.
Re:Show HN: TattoosAI – AI-powered tattoo artist, using Stab... by fragmede on Saturday September 10, 2022 @02:31AM (#32788364)
I don't have an AMD Mac to test on but on the Nvidia side of things there's support now for 4GiB cards with the right configuration, so it might be possible.