Music is tough. People like music which is a lot like what they're familiar with but just a little bit different. Musicians are always suing each other because it's hard to write a song which doesn't sound dangerously like an existing song, which is why Taylor Swift is generous with writing credits. It's a big problem for LLM generated music, regardless of the training data.

Myself I have gone through phases in my adult life where I tried hard to expand my musical interests. Like around the time my son was born I was really into obscure psychedelia, both vintage and contemporary and also prog rock and other rock B-sides from the 1970s. Then later I got into the british 1980s music I missed. Then it was Ingsoc and then the Super Furry Animals, lately Tyler the Creator. One thing that's driven it is that I make these cards

https://mastodon.social/@UP8/115939341268444811

and don't want them to show my age!