…until I tried the same on my RTX 4070 and it made my Mac look like a joke.
For the 30 seconds my Mac would have taken for 1 result, which will probably need revising, the RTX would give me 30 results.
However the RTX was half the cost of my Mac, so it’s not a good investment if I just want to generate some images. I’d rather pay for the cloud if I didn’t have the RTX already.
The actual best image AI, midjourney, is probably a gigantic model under the hood, that takes 8 A100s to run (Aka more than 100GB VRAM). That's why their quality is leaps and bounds above stable diffusion XL, its because the model size simply allows for it.
Model sizes continuously grow to exploit the available hardware to the limit. Midjourney and GPT-4 have both proven that model quality is decisive to success and paying customers, so consumer hardware can never catchup to whatever Nvidia sells to the cloud.
Do you have any source for this speculation? In my experience image models are always much smaller than language and even the largest llama will fit in a smaller GPU machine than that.
Unet are really expensive to run compare to a regular GPT model and they are compute-bound thx to convolution, a reason why no one has trained a unet that comes close to consume 100GB of VRAM during inference. I doubt that MJ is much bigger than SD XL, it's good but not revolutionary.
For me it kicks the shit out of Midjourney in flexibility and quality. I can make more images of higher quality, faster and cheaper.
An optimized XL model in the hands of an expert beats it, handily.
And Adobe sells to experts, not consumers for the most part.
Energy, partial hardware cost, setup time, fine-tuning time.
But someone needs to make this possible and maintain such a solution which would cost also money.either you pay adobe what you already do or pay someone else who maintains the model, the infrastructure etc.
Sure some will run it themselves but my guess is that this is a niche group of people as most don't care .
And designing your software to a minimum-spec of a 3080 would be pretty wild.
This is referring to the Photoshop stuff, which is way better than any type of SD inpainting for removing things from images. Firefly might be slower? I haven’t used it since it first came out.
I agree for just general image generation SD or Midjourney are better options in their own way.
xformers, 1024x1024x diffuser pipeline.
They seem like pretty much the perfect fit for cloud - burst compute which would result in very low hardware utilisation if ran locally.
Why would it be better to have a $1,500 GPU that is weak and used infrequently, when you could share a big cluster of better GPUs shared between a big group of people, and have it more heavily utilised?
There is a philosophical argument about owning your own hardware etc, however I think the economics and performance will eventually push this to the cloud for most use-cases (most people will just get better bang-for-buck in the cloud).