It might require dedicated hardware. That only really becomes possible when you've proven the idea, but ASICs for cryptomining, TensorFlow, etc are quite real. There's no reason why dedicated hardware for training Stable Diffusion couldn't happen.