Re:JavaScript singing synthesis library
by usdivad on Wednesday October 12, 2016 @03:12PM
(#12695677)
Thanks for the feedback, and yeah I agree that it's pretty primitive at the moment (it can't even do legato!). I'm working on improving it though, and hopefully it demonstrates some of the potential for Web Audio applications; I actually originally made this for a demo session at this year's Web Audio Conference [0].
Modeling singers using machine learning would be really neat; I'm not too hip to the current research around that, although the idea brings to mind WaveNet [1], which seems like it'd be absolutely fascinating to try with pitched audio / using musical parameters.
[0] http://webaudio.gatech.edu/
[1] https://deepmind.com/blog/wavenet-generative-model-raw-audio...
Re:JavaScript singing synthesis library
by gattilorenz on Thursday October 13, 2016 @05:42AM
(#12699547)
well, something better than Vocaloid does exist: http://mtg.upf.edu/research/labs/mir-lab/vap
It's from the same University that helped develop Vocaloid, and if you look at (well, listen to) their INTERSPEECH 2016 submission you'll find it's another league entirely ( https://chanter.limsi.fr/doku.php?id=winner_of_the_singing_s... )
Re:JavaScript singing synthesis library
by kranner on Thursday October 13, 2016 @01:29AM
(#12698669)
Related software for iOS musicians: https://klevgrand.se/products/jussi/
Somebody really needs to crack singing synthesis. Vocaloid from Yamaha is good, but it works by having a live singer sing a prescribed set of phrases, which are then reassembled. Automatic singer generation is needed.
Figure out some way to use machine learning to extract a singer model from recorded music and generate cover songs automatically. Drive the RIAA nuts. Get rich.