One thing I thought would be pretty cool - I've got a friend who did a phd on physical modeling of sound in Edinburgh - http://www.ness.music.ed.ac.uk/. Often those physical models have hundreds of parameters and it's quite difficult to tune them to make meaningful/good sounds. Perhaps a neural network would be useful for tuning the parameters - you could use a real musician playing a real instrument with sensors, and use the generated sensor data and audio for your training set. And then the neural network could learn to match the physical model parameters to that.
I'm not sure how to articulate this. I have synths that I can program in my head because I know the architecture really well and when I imagine a sound I can walk over and dial it in from the front panel and get more or less what I expected, plus I can then tweak the results with abandon and for musical satisfaction. Then I have others (sometimes from the same manufacturer which emit all manner of nice sounds but are far harder to program and easily veer off into sonic mush - technically impressive but not really fun to play.
I also think wavenet sample by sample generation and interpolation between latent features doesn't sound that exciting, as cool as it technically is.
We'll find some place to use machine learning in music/audio eventually :) I think perhaps more natural sounding pitch shifting could be one area (since you could learn the structure of sound of different instruments at various pitches), reverb removal, denoising, polyphonic audio to midi - things like that, where you have obvious training data.
Well, they are probably not tuning 100 instrument parameters but only the play characteristics like accent, velocity and so on.
http://www.nordkeyboards.com/sites/default/files/files/downl...
The Hartmann Neuron took a similar approach with neural networks in 2003: https://www.soundonsound.com/reviews/hartmann-neuron
I mean, well done and everything, it's a good project, but Synthesize Brand New Sounds In Ways Never Before Possible!!! is a pitch that synth users hear year after year (pun intended). It turns out that musicians don't like black box patching all that much, but prefer morphing things in parameter space because being musicians they want to interact with their instruments, whether that's timbrally, melodically, or harmonically.
Electronic musicians in particular don't need More Sounds or even More Oscillators and More filters and More FX - sure, those are interesting, but honestly people are already spoiled for choice. What people like most is an instrument whose timbral range may be limited but which has a strong center - secondary characteristics remain largely consistent as primary variables are manipulated, so oscillators don't thin out at higher or lower ranges, filter Q negative feedback gain isn't damped so aggressively that it changes gain structure and so forth. The nicest thing an electronic musician can say about an instrument is not 'it can make so many sounds' but 'you can't get a bad sound out of it.'