Re:Ask HN: What were the papers on the list Ilya Sutskever g...
by albertzeyer on Friday February 03, 2023 @01:56PM
(#34646124)
The authors did not really expect it to be such a huge influence. You could also argue, it is a somewhat natural next step. This paper did not invent self-attention nor attention. Attention was already very popular, specifically for machine translation, and a few other papers already did use self-attention at that point in time. It was just the first paper which solely used attention and self-attention and nothing else.
[ Parent
| on HN ]
There are no comments on this comment yet.