Re:SoundStream: An End-to-End Neural Audio Codec
by vletal on Sunday August 15, 2021 @04:01AM
(#28186986)
Have you ever played a counterstrike with a lagging network? Observe the teammates running into walls and such. That's what the conversation would sound like.
[ Parent
| on HN ]
Re:SoundStream: An End-to-End Neural Audio Codec
by vbezhenar on Sunday August 15, 2021 @10:26AM
(#28188994)
Running into a wall is not a result of NN prediction. It's a result of naïve linear prediction. NN will predict that he'll stop, turn around, may be shot someone. The hard thing is to not disappoint NN by actually running into a wall.
Re:SoundStream: An End-to-End Neural Audio Codec
by vletal on Sunday August 15, 2021 @02:49PM
(#28191314)
You need to take into consideration the complexity. Counterstrike has very tiny set of possible actions you can take. Compare that to the space of things one can say.
A NN is going to fail on that at least as missereably as linear interpolation fails in CS.
Re:SoundStream: An End-to-End Neural Audio Codec
by hypertele-Xii on Monday August 16, 2021 @06:31AM
(#28196617)
When speech prediction fails, it should sound clearly wrong. Otherwise we risk serious misunderstanding when the prediction says something that sounds good but means different.
We already have trouble like this with texting autocorrection.