Re:Researchers achieve speech recognition milestone
by gok on Wednesday September 14, 2016 @06:47PM
(#12501860)
All language models attempt to model what word is more likely in a given context :)
What is somewhat unusual about this approach is they use recurrent neural networks for the language modeling, as opposed to more traditional approached like a backoff n-gram model.
Re:Researchers achieve speech recognition milestone
by nl on Wednesday September 14, 2016 @07:24PM
(#12502079)
Most modern language modelling is RNN based now; eg: https://arxiv.org/abs/1602.02410 (which I think is SOTA).
The Microsoft system also does this: it uses language modelling to attempt to model what word is more likely in a given context. This gives them a 18% word error rate reduction (see section 7 of the paper: http://arxiv.org/pdf/1609.03528v1.pdf).