Yes exactly. You can even get a head start by training on award-winning performances by Izhak Perlman and such, comparing them to the sheet music. Then your NN will be able to read sheet music in the style of Perlman, the same way that GPT2 can write in the style of Tolkien.
Kasparov remarked that Deep Blue seemed to make insightful moves in a way that wasn't machine-like, and he suspected it was human assisted. I don't know if he was right or wrong, but I'm sure today's chess software will feel at least as insightful as Deep Blue did to a chess grandmaster, especially if they think they're playing against a human.
As others wrote, this will be the first to go. In fact, I believe current breed of NNs can do this already.
Artistic creativity is a trivial problem compared to all others. All you have to do is inject a bit of randomness to the process and then not tell people that the work was done by a computer program.
The "interpret sheet music with feeling" actually happens within the brain of the listener, who tries to connect the music and feelings it evokes in them to a vision of a human being who created that music. In other words, emotions are actually projected. The mechanism works somewhat well if the artist is a human with clear intent of creating emotional impact. But when the artist doesn't intend to create that impact, the audience will find one in there anyway. And so will they if the artist is actually a matrix multiplicator running on a stack of GPUs.
The same phenomenon happens in writing[0], but writing (and similarly, painting) is harder, because the sentences have to have at least some semblance of sense[1]. In music, anything that's not just pure white noise can get accolades for creativity if you insist hard enough that it was composed by a gifted human.
--
- [0] - Ever heard of the stories about people building these whole towers of interpretations of a literary work, and then when someone asks the author whether they meant any of that, it turns out the whole edifice is just a pile of bullshit, and the author really just wanted to write a story they liked?
- [1] - But see https://slatestarcodex.com/2019/03/14/gwerns-ai-generated-po..., in particular near the end of the post.