Re:Google is not a tech company
by riku_iki on Saturday November 18, 2023 @08:48PM
(#38327453)
attention layer: core of transformer, was invented outside of Google.
[ Parent
| on HN ]
Re:Google is not a tech company
by user_named on Saturday November 18, 2023 @11:22PM
(#38328911)
I thought that was pioneered in the paper that came out of Google?
Attention was first proposed in this paper: https://arxiv.org/pdf/1409.0473.pdf and it is referenced from transformer paper.
Re:Google is not a tech company
by VeejayRampay on Monday November 20, 2023 @03:57AM
(#38345062)
at this rate no one ever invents anything cause everything is built on math
that some of the elements came out of somewhere else doesn't change the fact that Google came up with an impressive and game-changing piece of tech