Re:Biological Function Emerges from Unsupervised Learning on...
by nl on Wednesday May 01, 2019 @06:27AM
(#19795867)
The Attention Is All You Need paper is where Transforms were introduced:
We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely.
We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely.