Direct copying yes, but stealing ideas? No. Actually it is a well-known practice in the art industry to use several existing works as references, and creating new artwork that is bit of mixture of all of them.
That is exactly what DALL-E/StableDiffusion are trying to do.
AI isn't borrowing pixels, either. If you read the idea of diffusion models, quite the opposite, what it directly learns is how to destroy an image from what it is into gaussian noise. The trick here is we can reverse this process 'creating' arts from noises.
There is no copying pixels, not even in the most simplistic version of how this model works.
All this goes out the window with AI, we have to judge the entire model as a whole, and even though we see DALL-E etc spit out watermarks we can't call it a liar or a thief. "This part overfits but the whole model is transformative, we think" say the authors.
I disagree with this, we don't just hear about ideas we actually see the art. Both are shown pictures.
Humans also are good at taking inspiration from ideas, where today’s AI is borrowing pixels. The AI is copying in a way that humans don’t, it’s not mimicking and taking inspiration - that is anthropomorphising the software that is trained and programmed to make automated mashups of images.
So in part it depends on what we do with AI images. There may be nothing wrong with training on copyrighted material if the resulting inferences are never distributed publicly nor used for commercial purposes. Of course that seems extremely unlikely, which is why it needs to be discussed carefully and debated in good faith, right?
Maybe in part it also depends on whether the AI software is guaranteed to produce something very different from any individual training image. If the outputs are guaranteed to be always a mashup, and never indistinguishable from any single input, that seems like it would be an easier pill to swallow. (There appears to be legal precedent along these lines for music sampling.)