News for hackers. Stuff that matters.
Re:Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing ... by stochastic_monk on Wednesday March 27, 2019 @07:48PM (#19507516)
Transformer-XL uses recurrence, and most NLP SOTA is still with LSTMs. I’m not sure I’d expect attention mechanisms to fully replace recurrence.

There are no comments on this comment yet.