Yes but there is transformative work involved in the process, which is what the model does. It's not a non-transformative simple display of the work (say when I show a movie), but deeply transformative.

But it's still illegal for me to download a movie without a license, even if I just intend to make AMVs with/ "transform" it.

OpenAI's entire argument is that they think this shouldn't apply to them, because they don't want to have to make deals with the original content authors in order to get legal copies to use in their training, because that would be expensive.

It wouldn't just be expensive, it would basically be impossible to figure out the content owners of random works on the internet at the scale needed for the LLMs to output the high quality content that they do output. Even if they strike deals with the large content owners, they need way way more content than that.

Too bad. No one has a right to mass data collection.

With Chain-of-Thought and Mixture of Experts, it may be that, in the long-term, most LLM output is primarily consumed by other LLMs [1]

[1] (meme, the future of communication) https://www.reddit.com/r/ChatGPT/comments/123tyge/the_future...