Re:Ask HN: What is the state of OSS voice cloning?
by popalchemist on Wednesday October 02, 2024 @04:02AM
(#41718270)
https://huggingface.co/spaces/TTS-AGI/TTS-Arena
[ Parent
| on HN ]
Re:Ask HN: What is the state of OSS voice cloning?
by dmckinno on Wednesday October 02, 2024 @11:53AM
(#41721913)
This is a bit different. These audio clips use the default voice of each of these systems. I was asking about zero-shot voice cloning, i.e. transferring a recorded voice and synthesizing speech in that voice.
I tried zero-shot voice cloning in all of the top OSS models in the Arena and performance was bad.
Re:Ask HN: What is the state of OSS voice cloning?
by popalchemist on Thursday October 10, 2024 @01:01AM
(#41795681)
Most of those models DO do zero shot cloning. The best is VoiceCraft. It's nearly 11Labs quality. Check it out.
Re:Ask HN: What is the state of OSS voice cloning?
by dmckinno on Thursday October 10, 2024 @10:30PM
(#41805477)
Thanks for the flag. VoiceCraft is indeed the best ZS OSS voice cloning tool, despite appearing at the bottom of the TTS arena They have a really easy-to-use gradio demo on their repo if anyone else wants to give it a try.
There is still a big gap between 11Labs and Character.ai and the VoiceCraft voices would not be confused for the real speaker, but this is much closer.