Re:Lyebird: Clone Your Voice
by Budabellly on Wednesday September 09, 2020 @04:32PM
(#24425607)
text2speech and speech2speech seem like very different problems no? Especially when so much of someone's voice identity is based on speech patterns, contextual inflection, rhythm/cadence, how would realtime work? Just wondering if you are thinking about realtime as in <10ms or realtime as in 1 second?
Awesome progress by the way, would totally follow along more closely on this project through an eng diary or mailing list.
Re:Lyebird: Clone Your Voice
by ValentineC on Wednesday September 09, 2020 @03:24PM
(#24424807)
Neat stuff!
What would it take to get Morgan Freeman's voice onto it?
Thanks!
I made one attempt at Morgan Freeman but I didn't have enough sample data. He narrated a few audio books, but they've either got background music that ruins the training or he collaborated with other speakers.
What data I gathered I obtained from interviews on YouTube. Unfortunately they're all so short that it's a lot of work to extract meaningful training data.
I really want his voice. I'll definitely get back to it.
Re:Lyebird: Clone Your Voice
by ValentineC on Friday September 11, 2020 @01:38PM
(#24445237)
If you need training data and don't mind it being from grey-area sources, I can help with supplying the audio tracks from some of his narration or acting work. Email's in my profile.
You really just need to get it to say "Morgan Freeman" over and over again.
Re:Lyebird: Clone Your Voice
by one_comment on Wednesday September 09, 2020 @03:41PM
(#24425036)
Would it be possible to have shareable links? Like vo.codes/?speaker=Bart&text=I'm+out
I made https://vo.codes as a side project to democratize text to speech. It's got lots of celebrities, politicians, cartoon characters, and tech figures (Paul Graham, Sam Altman, Mark Zuckerberg, et al)
Kids on YouTube found it and are making incredible music videos with it.
Homer Simpson and SpongeBob cover Money Machine: https://youtu.be/iBpqJF5LXX4
SpongeBob covers WAP (NSFW!) : https://youtu.be/dSgd4PoQofQ
SpongeBob covers 6IX9INE : https://youtu.be/IKs5iWVRE94
I'm planning to do the same thing as these folks after I finish my real time voice conversion system. It's a killer app for Discord and TeamSpeak - you can talk in real time as Gilbert Gottfried, SpongeBob, or Donald Trump.