Re:Training a Recurrent Neural Network to Compose Music
by visarga on Sunday August 21, 2016 @08:42PM
(#12333450)
In the training phase the network learns to predict the next note from the past few beats. As training data it uses a bunch of text formatted midi files. In generative mode, they just feed back the generated notes into the network at each step. The same approach can be used to generate DeepDrumpf[1] or any kind of time series.
[1] https://twitter.com/deepdrumpf
Funny, this is DeepDrumpf bad mouthing Andrej Karpathy, the inventor of this algorithm (char-rnn):
Re:Training a Recurrent Neural Network to Compose Music
by wodenokoto on Sunday August 21, 2016 @09:02PM
(#12333518)
I believe Karpathy Char-RNN is from 2015 (that is at least the year on the 100-line gist and the "unreasonable effectiveness of ..." blog post[0]) but char-level RNN language models dates back to at least 2011 with [1]
So I don't think we should call him the inventor, though he definitely popularised it with his great writing and examples.
[0] http://karpathy.github.io/2015/05/21/rnn-effectiveness/ [1] Sutskever, Ilya, James Martens, and Geoffrey E. Hinton. "Generating text with recurrent neural networks." Proceedings of the 28th International Conference on Machine Learning (ICML-11). 2011.
Re:Training a Recurrent Neural Network to Compose Music
by slagfart on Sunday August 21, 2016 @09:18PM
(#12333556)
I'd love to see DeepDril, derived from https://twitter.com/dril
Here's all his tweets: http://greptweet.com/u/dril/dril.txt
So the training set is just text files containing songs? How does it test if the output is correct or not? If I understand correctly the goal here was just to produce outputs in the correct format. If one wanted to train for quality as well would one need to grade every output the network produces by hand?