News for hackers. Stuff that matters.
Re:Jeff Geerling – They stole my voice with AI by CoastalCoder on Sunday September 22, 2024 @08:38AM (#41616620)
> I had my 70 year mother ask me last week if she should remove her voicemail message because can't people steal her voice with it? I was surprised but I guess she heard it on a Fox segment or something.

Out of curiosity, how much training data is needed currently to mimic a voice at various levels of convincingness?

Re:Jeff Geerling – They stole my voice with AI by alternatex on Sunday September 22, 2024 @08:47AM (#41616663)
Skype does it in real time (for live translation) with a few seconds of audio. For the reasons discussed in this thread, it continuously forgets its previous training from the call to not make the voice too similar, but just similar enough to distinguish the speakers.
Re:Jeff Geerling – They stole my voice with AI by jerpint on Sunday September 22, 2024 @08:51AM (#41616683)
Just a few seconds of speech gets you pretty far with a lot of models
Re:Jeff Geerling – They stole my voice with AI by caeril on Sunday September 22, 2024 @11:55AM (#41617902)
Yes, this is generally true, in order to clone the timbre/pitch/tonality, but if you're going to run a voice cloning scam to fool friends and family members, you need much more to get the cadence, pauses, vocal tics, etc right.
Re:Jeff Geerling – They stole my voice with AI by HeatrayEnjoyer on Sunday September 22, 2024 @12:32PM (#41618132)
Almost none, at most as little as a professional impersonator requires. GPT-4o's advanced voice mode would clone the user's voice by accident. A recording clip of one incident is available:

>During testing, we also observed rare instances where the model would unintentionally generate an output emulating the user’s voice.

>Example of unintentional voice generation, model outbursts “No!” then begins continuing the sentence in a similar sounding voice to the red teamer’s voice

https://assets.ctfassets.net/kftzwdyauwt9/4CG0G7y9WOfEkzBpi7...

https://openai.com/index/gpt-4o-system-card/