News for hackers. Stuff that matters.
Re:SoundStream: An End-to-End Neural Audio Codec by whazor on Sunday August 15, 2021 @02:48AM (#28186725)
I wonder if this approach would discriminate against certain voices.
Re:SoundStream: An End-to-End Neural Audio Codec by jcims on Sunday August 15, 2021 @03:47AM (#28186943)
Almost certainly, but this is true of most low bitrate codecs. I've got a very deep voice and it becomes largely unintelligible in marginal mobile signal conditions. If anything this one might be more tweakable and/or personalizable than what we use today.
Re:SoundStream: An End-to-End Neural Audio Codec by dan-robertson on Sunday August 15, 2021 @06:19AM (#28187637)
To some extent, surely. In their samples they have some music and some audio with background noise. The music survives ok and the clanging of the background noise is reduced to clicking so maybe languages with clicking sounds do ok too.

I suppose there are a few futures:

- the paper was very innovative but nothing really happens in the ‘real world’

- Google roll it out globally to one of their products and we discover that some voices/accents/languages work poorly (or well)

- The same but with slow rollout, feedback, studies, and improvements to try to make sure everyone gets a good result.

Re:SoundStream: An End-to-End Neural Audio Codec by patrakov on Sunday August 15, 2021 @03:17AM (#28186835)
For the previous version of Lyra, there was a concern that it would discriminate against some languages.