News for hackers. Stuff that matters.
Re:Navigating the Challenges and Opportunities of Synthetic ... by zaptrem on Friday March 29, 2024 @01:52PM (#39866967)
I thought everyone (11Labs, open source, OpenAI even) already has human-level TTS models? Is there still an open challenge somewhere (e.g., is there a use case where a better model would make any difference?).
Re:Navigating the Challenges and Opportunities of Synthetic ... by zachthewf on Friday March 29, 2024 @02:22PM (#39867331)
Expressivity and naturalness are still not good enough. It's getting there, but today you'd never have a voice conversation with an AI and come away thinking "boy, what an engaging, charismatic personality that AI had!" This is partly due to latency, partly due to imperfect speech-to-text which is too slow and doesn't understand conversational dynamics or nonverbal signals, but yes partly due to text-to-speech.

When it comes to naturalness for dialog, OpenAI actually has the best voices I've heard—significantly better than Azure or 11 Labs which are second and third best. But at least the voices they expose through ChatGPT are fairly muted and inexpressive.

Re:Navigating the Challenges and Opportunities of Synthetic ... by kenjackson on Friday March 29, 2024 @01:55PM (#39867022)
I haven’t seen any TTS take 15 second audio samples and capture the speech so well.

It’s getting clearer — in the future, if you didn’t see it happen in real life then it didn’t happen.

Re:Navigating the Challenges and Opportunities of Synthetic ... by the_snooze on Friday March 29, 2024 @03:34PM (#39868090)
>It’s getting clearer — in the future, if you didn’t see it happen in real life then it didn’t happen.

I'm convinced that all these AI technologies have legitimate use cases. But it's far too easy to use them to generate endless streams of noise, spam, and mistrust and drown out anything valuable.

Re:Navigating the Challenges and Opportunities of Synthetic ... by zaptrem on Friday March 29, 2024 @02:00PM (#39867083)
Idk training a model like this is kinda trivial for most shops. Afaik there are open source ones that do the same thing. We trained one with similar audio quality to this by accident while working on music generation.
Re:Navigating the Challenges and Opportunities of Synthetic ... by belter on Friday March 29, 2024 @01:59PM (#39867075)
Even that...Everybody better get their own Certificate Authority and a family password.