Re:Single Headed Attention RNN
by technics256 on Wednesday November 27, 2019 @11:25AM
(#21649223)
Are qRNNs still used much?
[ Parent
| on HN ]
Re:Single Headed Attention RNN
by polymorph1sm on Wednesday November 27, 2019 @10:24PM
(#21654368)
check out MultiFiT [0] from fastai, it uses QRNN for speed.
[0] http://nlp.fast.ai/classification/2019/09/10/multifit.html