News for hackers. Stuff that matters.
Re:ESpeak-ng: speech synthesizer with more than one hundred ... by vidarh on Thursday May 02, 2024 @01:14AM (#40232918)
I feel like you. Relatively simple formant models gets "close enough" that it feels like you should be able to do well with very little.

One of the things I've long wanted to do but not found time for, is to take a few different variants of formant synths, and try to train a simple TTS model to control one instead of producing "raw" output. It's amazing what TTS models can do with "raw" output, but we know our brains aren't producing raw, unconstrained digital audio, and so I think there's a lot of potential to understanding more and simplifying if you train models constrained to produce outputs we know ought to be sufficient, and push their size as far down as we can.

Re:ESpeak-ng: speech synthesizer with more than one hundred ... by vidarh on Thursday May 02, 2024 @04:14AM (#40233857)
Too late to edit, but to any one who needs "convincing" of the flexibility of a formant synthesizer, you should 1) play with Pink Trombone[1], a Javascript formant synthesizer with a UI that lets you graphically manipulate a vocal tract, and 2) have a look at this programmable version of it[2]

[1] https://dood.al/pinktrombone/

[2] https://github.com/zakaton/Pink-Trombone

Re:ESpeak-ng: speech synthesizer with more than one hundred ... by drcongo on Thursday May 02, 2024 @04:59AM (#40234129)
Thanks for those links, that's superb. Sounds surprisingly like the "Oh long Johnson" cat - https://www.youtube.com/watch?v=kkwiQmGWK4c
Re:ESpeak-ng: speech synthesizer with more than one hundred ... by codedokode on Thursday May 02, 2024 @12:20PM (#40237998)
What a fun toy! But I mostly get sounds of a drunk man who tries to say something but cannot.
Re:ESpeak-ng: speech synthesizer with more than one hundred ... by vidarh on Thursday May 02, 2024 @02:05PM (#40239429)
Check out the videos in the second link - it gives some better examples of what you can do with it.
Re:ESpeak-ng: speech synthesizer with more than one hundred ... by tapper on Thursday May 02, 2024 @12:20PM (#40238002)
Funny that the Pink Trombone website does not work with screen readers.
Re:ESpeak-ng: speech synthesizer with more than one hundred ... by vidarh on Thursday May 02, 2024 @02:10PM (#40239515)
It's entirely visual in that it is a graphic of a vocal tract where you can move the tongue and shape the mouth, so in that form trying to make it do anything with screen readers would mean basically doing what the second link does, and create an API for it and hook the backend up to an entirely different UI.

The videos on the other link does show that the guy who has done that API has done stuff to the UI to allow interfacing to it in non-graphical ways, but sadly I don't see any online demos of those alternative user interfaces anywhere, which is a great shame. Sadly it doesn't look like the videos are very accessible either, as they're mostly demos with no commentary about what is going on on the screen, without which they're mostly just random sounds.

Re:ESpeak-ng: speech synthesizer with more than one hundred ... by follower on Thursday May 02, 2024 @04:03PM (#40240802)
Yeah, Pink Trombone is awesome[0]. :D

Thanks for the link to the programmable version--I don't think I'd been aware of that previously...

[0] And, from personal experience, also rather difficult to "safely" search for if you don't quite remember its name exactly. :D

Re:ESpeak-ng: speech synthesizer with more than one hundred ... by nuc1e0n on Friday May 03, 2024 @03:11PM (#40251167)
That reminds me of Google's blob opera: https://artsandculture.google.com/experiment/AAHWrq360NcGbw