Transformers's analyze images, they don't copy them. You might call this semantics, but you probably also wouldn't call out an algorithm that counts black pixels on website images as "copyright violation".
There is a lot of nuance here and a lot to consider. Transformers are not archives of images, they are archives of relationships. This is key because you don't have to copy an image to measure the relationships between it's pixels.
Train a transformer on one image, and it will just output noisy garbage.
Totally new situation for humanity that almost no one saw coming. So artists are forced to use the outdated and lone weapon they have; copyright claims.
disclaimer: I'm just devil advocating. I don't believe this discussion is productive. the time for IP protection to be necessary for social good has gone and now it's just a time wasting idea
It becomes a little less obvious when you learn that the models which had petabytes of images "go into it" are <10GB in size.
You have 5 million artists on one hand saying "My art is in there being used" and you have a 10GB file full of matrix vectors saying "There are no image files in here" on the other. Both are kind of right. ish. sort of.