Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by lucidrains on Wednesday March 29, 2017 @11:17PM
(#13992586)
can we eventually apply style transfer to speech? I'd like to hear all audio narration in the voice of David Attenborough.
[ Parent
| on HN ]
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by visarga on Wednesday March 29, 2017 @11:47PM
(#13992703)
Maybe not yet, but I am sure there will be speaker cloning extension soon, like photo and painting style transfer.
Edit: It would seem they only need 25 hours of audio to train the model, so it would probably be easy to find or make alternate datasets.
> We train Tacotron on an internal North American English dataset, which contains about 24.6 hours of speech data spoken by a professional female speaker
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by dharma1 on Thursday March 30, 2017 @05:09AM
(#13993919)
It's not really style transfer, but for a new speaker model, you just need to train each speaker with a dataset of 25 hours audio with time matched accurate transcriptions.
In the case of David Attenborough, I'm pretty sure that amount of data is available with subtitled BBC content.
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by dnautics on Thursday March 30, 2017 @12:25PM
(#13996754)
Oh I doubt that will be necessary. I bet you could find a useful "feature vector" by repeating the process on about 10-20 new voices - then extract a set of words (let's pessimistically say 100) that activate these features the most - then have a person retrain with 5 examples of each of these 100 words (an hour, at the most).
I honestly wouldn't be surprised if you could find a really feature rich sentence (say 5 words long) that you could use to crack pretty much all voice-activated biometric password systems.
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by slinger on Thursday March 30, 2017 @04:41PM
(#13998683)
Is voice-activated password a thing? I mean, I only saw that in sci-fi movies and never in real life.
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by dharma1 on Thursday March 30, 2017 @05:27PM
(#13999021)
Yes, voice biometrics are used in telephone banking for instance
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by dharma1 on Thursday March 30, 2017 @05:32PM
(#13999068)
yep, I'm sure there would be a lot of similarity between models that could be used to reduce training time
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by starmole on Thursday March 30, 2017 @01:38AM
(#13993191)
Adobe VoCo does something like that. Demo: https://www.youtube.com/watch?v=I3l4XLZ59iw
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by mbrookes on Thursday March 30, 2017 @04:48AM
(#13993841)
It was pointed out the last time I posted this that the demo is "fake" at least in as much as the inserted words aren't being synthesized but rather copy-pasted with existing intonation intact.
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by NKCSS on Thursday March 30, 2017 @02:19AM
(#13993327)
That's pretty cool; any info on a release date?
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by gwern on Thursday March 30, 2017 @03:13PM
(#13998063)
My understanding is that while a number of people have tried, we currently have no particularly viable approaches for 'style transfer' analogues on sequence data, including text and sound/speech. Samples from past work are pretty bad. But what you could possibly do is roundtrip audio to text and then text (with conditioning like speaker metadata) to speech, both of which are doable. But directly transforming, not yet.
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by abdias on Thursday March 30, 2017 @12:26AM
(#13992892)
You mean, like they did pre-2000 [1]? Don't know how good this would sound today, but nevertheless interesting.
[1] http://www.washingtonpost.com/wp-srv/national/dotmil/arkin02...
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by slinger on Wednesday March 29, 2017 @11:57PM
(#13992750)
I was wondering the same thing! I think, in the future this might be a problem for national security
Re:Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
by crooked-v on Wednesday March 29, 2017 @11:56PM
(#13992746)
Comedy option: Gilbert Gottfried.