Re:Transformer: A Novel Neural Network Architecture for Lang...
by sdenton4 on Friday September 01, 2017 @01:39AM
(#15146389)
The paper linked in the blog was actually published back in June. And as the sibling comment says, people have been trying to use attention mechanisms to augment recurrent networks for some time. The novel idea here seems to be sorting the recurrent network, and just keeping the attention mechanism.
[ Parent
| on HN ]
There are no comments on this comment yet.