Re:Voc: a physical model of the vocal tract, written in ANSI C
by macawfish on Monday June 12, 2017 @08:48PM
(#14542250)
Would this be a good target for deep learning? It's low level in some sense, but still nicely parametric. It strikes me that this could be a good synth for some neural nets to learn how to play.
[ Parent
| on HN ]
Re:Voc: a physical model of the vocal tract, written in ANSI C
by vortico on Monday June 12, 2017 @08:57PM
(#14542272)
Yes, speech recognition and speech generation would be easier to implement if you used neural networks that were trained on these vocal cord inputs rather than audio samples. In either case, you'd need to solve the inverse problem to generate vocal cord parameters given an audio sample. This seems difficult but I'd imagine some commercial software packages do it to some extent.
Re:Voc: a physical model of the vocal tract, written in ANSI C
by smaddox on Monday June 12, 2017 @09:50PM
(#14542419)
Or you could let the neural network solve the inverse problem for you, at least for speech generation.
Re:Voc: a physical model of the vocal tract, written in ANSI C
by skykooler on Tuesday June 13, 2017 @12:57AM
(#14542929)
I would imagine a neural network that fed parameter values to Voc would be far faster (real-time?) than something like WaveNet which needs to sample the output thousands of times a second.
Re:Voc: a physical model of the vocal tract, written in ANSI C
by zebproj on Tuesday June 13, 2017 @01:03AM
(#14542944)
Correct. WaveNet is a very brute force approach to speech synthesis.
Re:Voc: a physical model of the vocal tract, written in ANSI C
by zebproj on Monday June 12, 2017 @10:37PM
(#14542549)
It seems like it would be, right? There are 44 tract-diameters you can modify to shape the vocal tract, and these can be used to generated specific vowel formants. I can imagine you can build a system using deep learning that can find the best parameters to match a steady state periodic pitch. It's a bit how some speech codecs work, like LPC10.
Re:Voc: a physical model of the vocal tract, written in ANSI C
by woodson on Monday June 12, 2017 @10:50PM
(#14542577)
Problem is, the output would sound pretty metallic, just like LPC10.
Re:Voc: a physical model of the vocal tract, written in ANSI C
by zebproj on Monday June 12, 2017 @11:39PM
(#14542723)
Maybe, maybe not. LPC10 is a 8kHz speech codec optimized for low-bandwith signals. The Kelley-Lochbaum is a full-blown physical model of the tract.
What you put into the filter is important. The LF glottal pulse model used here is a pretty good excitation signal... aspiration noise REALLY makes a difference. It would still sound artificial, but it definitely wouldn't sound metallic.