News for hackers. Stuff that matters.

A comment on Forget subtitles: YouTube now dubs videos with AI-generated voices. Parent comment

Re:Forget subtitles: YouTube now dubs videos with AI-generat... by Moldoteck on Sunday July 30, 2023 @02:06PM (#36934137)
AI dubbing would never reach that level of acting, sounds awkward. - you should consider being more conservative in this direction)) I've said the same thing abt generating of images 5 years ago but the last progress of midjourney/dalle proved me wrong. We should not underestimate what hights human progress can achieve
[ Parent | on HN ]
Re:Forget subtitles: YouTube now dubs videos with AI-generat... by danielbln on Sunday July 30, 2023 @02:13PM (#36934223)
Op also clearly hasn't used Elevenlabs or similar tools. If you clone a professional narrator it already sounds incredibly good and effectively indistinguishable from a human. Giving acting directions to the model to steer the output (kind of like ControlNet does for Stable Diffusion) seems like a logical next step.
[ Parent | on HN ]
Re:Forget subtitles: YouTube now dubs videos with AI-generat... by patall on Sunday July 30, 2023 @02:42PM (#36934533)
But in this case, they want to avoid the human input. So, I guess, it would rather work by reading and copying the intonation of the source voice.
[ Parent | on HN ]