More importantly, the laws are representations of human feeling and social negotiation. Copyright law grew out of a complex array of beliefs and interests. E.g.: https://en.wikipedia.org/wiki/Statute_of_Anne
It could be that the various "AI" generative models are legal under current law. But it could also be that this is one of those things, like the printing press, that causes people to say, "Hey, that's not right," and change the law to rule out something that was previously legal.
"This is all 'wild west' to me as a European, but somehow I wonder if there is any guns that work to protect yourself by means of self-justice."
I vaguely remember a Stern magazine cover from around 2004, depicting a giant cowboy boot with "GM" decorated with red, white and blue coming down on a crowd of people standing in the shape of the Opel logo and titled something like "Der Wild-West-Method."
It was clearly not a compliment.
(Correction: GM had owned Opel for decades at that point, but was getting more aggressive with how it was run)