News for hackers. Stuff that matters.

A comment on Transformer: A Novel Neural Network Architecture for Language Understanding. Parent comment

Re:Transformer: A Novel Neural Network Architecture for Lang... by cosminro on Thursday August 31, 2017 @11:07PM (#15145819)
Attention is used in machine translation since 2014 as far as i know (Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio: Neural Machine Translation by Jointly Learning to Align and Translate) in various forms.
[ Parent | on HN ]

There are no comments on this comment yet.