Re:Computational Synesthesia: Audio Analysis with Image Proc...
by dchichkov on Tuesday October 01, 2013 @05:34PM
(#6479219)
That's pretty cool. Just for the fun of it, I also did something along these lines, trying to make a model of human voice with stacked denoising autoencoders (SDAs, which were used in the image recognition originally) in the compressed audio domain (MDCT, basically MP3, but without Huffman encoding). It worked, but a simple nearest neighbour model was producing a lot more realistic voice.
Here's how audio data in that compressed domain looks like [you'll need to zoom in]: https://raw.github.com/dchichkov/DeepLearningTutorials/maste...