News for hackers. Stuff that matters.

A comment on Google is not a tech company. Parent comment

Re:Google is not a tech company by riku_iki on Saturday November 18, 2023 @11:43PM (#38329065)
Attention was first proposed in this paper: https://arxiv.org/pdf/1409.0473.pdf and it is referenced from transformer paper.
[ Parent | on HN ]
Re:Google is not a tech company by VeejayRampay on Monday November 20, 2023 @03:57AM (#38345062)
at this rate no one ever invents anything cause everything is built on math

that some of the elements came out of somewhere else doesn't change the fact that Google came up with an impressive and game-changing piece of tech

[ Parent | on HN ]
Re:Google is not a tech company by riku_iki on Monday November 20, 2023 @05:16PM (#38355685)
It was not impressive at that time, because didn't achieve any quality breakthroughs. Later adapters of transformers like GPT and Bert achieved it with impressive results.
[ Parent | on HN ]