That's only true in a very narrow set of circumstances. Imagine the case where someone listens to 10,000 songs, and then takes the sum total of that experience and writes their own. There's no credit given to the inspiration that each of those 10,000 songs gave. And that is in fact much closer to what AI is currently doing.
https://www.ajschwartzlaw.com/can-i-use-that-part-2-remix-cu...
But all of this, doesn't have much to do with whether an AI should be allowed to consume public media -- even if we agree they need to do a better job about avoiding verbatim reconstruction when prompted.
Edit: I wasn't able to find the Lawrence Lessig talk I wanted to link, but here's a quite old one that makes some of the same points:
I’m not a lawyer but I’m pretty certain that’s not actually how things work.
This extends to music as well, if someone hears a song and is inspired by that in their work, the original artist gets credit.