News for hackers. Stuff that matters.
Re:Mozilla partners with Nvidia to democratize and diversify... by throwaway189262 on Monday April 12, 2021 @07:13PM (#26786315)
Mozilla TTS is a great open source speech generator that uses state of the art ML models. https://github.com/mozilla/TTS

If you need good TTS, this is it. It sounds as good as Google, Apple, or Amazon products, if you have a good data set. The pre trained models are decent enough for real use cases.

Datasets are the problem. Quality data is expensive. It takes about 24 hours of aligned and annotated quality voice samples to make a model.

The most common "open" dataset is LJSpeech. It's kinda noisy and recorded with a bad mic. And that greatly degrades quality of generated audio. It's still miles better than anything 5+ years ago, but has a metallic quality.

If anyone is interested, you can record your own voice to make a model for Mozilla TTS. What isn't talked about, is that modern ML voice models aren't synthetic voices, they're audio deepfakes. Clones. We're talking to the point your friends couldn't tell if it was you or the model on the phone.

Some people might find that scary but I think it's incredibly cool. If you build a great quality model for Mozilla TTS your voice can outlive you.

Re:Mozilla partners with Nvidia to democratize and diversify... by molza on Tuesday April 13, 2021 @06:10AM (#26790281)
I think the creator of the project has moved on and it is not maintained anymore. But they have https://github.com/coqui-ai/TTS
Re:Mozilla partners with Nvidia to democratize and diversify... by throwaway189262 on Tuesday April 13, 2021 @12:31PM (#26794898)
Quite sad, glad someone picked up the torch
Re:Mozilla partners with Nvidia to democratize and diversify... by toomuchtodo on Monday April 12, 2021 @08:19PM (#26786741)
Is there a guide you could recommend on building your own Mozilla TTS model? Or is the repo you linked to sufficient?
Re:Mozilla partners with Nvidia to democratize and diversify... by throwaway189262 on Tuesday April 13, 2021 @12:30PM (#26794889)
It's barely sufficient. Much of the docs is in various pull requests from others adding models. In another reply a user posted a better maintained fork repo
Re:Mozilla partners with Nvidia to democratize and diversify... by toomuchtodo on Tuesday April 13, 2021 @12:48PM (#26795187)
Thank you!