News for hackers. Stuff that matters.
Re:"Attention is all you need" paper digested by mensetmanusman on Saturday October 07, 2023 @03:52PM (#37804976)
It’s probably Nobel worth based on its world impact.
Re:"Attention is all you need" paper digested by numbers_guy on Saturday October 07, 2023 @04:31PM (#37805266)
World impact is not how Nobels are won. If that was the case Elon Musk, Jeff Bezos, Zuckerberg and others would all have multiple ones.

I honestly do not see this paper as being in the same magnitude of brilliance as a typical Nobel would be. Not to mention that it barely counts as science (actually it probably does not). Don't get me wrong. It is a huge achievement for both the machine learning research field and for humanity as a whole, but putting along the achievements of Nobel physicists and such feels wrong.

Re:"Attention is all you need" paper digested by dvngnt_ on Saturday October 07, 2023 @06:02PM (#37805927)
objectively speaking what makes them so much better?
Re:"Attention is all you need" paper digested by dinvlad on Saturday October 07, 2023 @05:28PM (#37805724)
What impact?
Re:"Attention is all you need" paper digested by esafak on Saturday October 07, 2023 @06:19PM (#37806017)
It's used in all sorts of models, like LLMs and image generators. It's probably the most popular foundation of advanced ML models today.
Re:"Attention is all you need" paper digested by dinvlad on Saturday October 07, 2023 @10:14PM (#37807284)
Right, but what is their "world impact"?
Re:"Attention is all you need" paper digested by esafak on Sunday October 08, 2023 @01:01AM (#37807987)
That of allowing people to generate, synthesize, and transform all major modalities of media, from text, to audio and video, for peanuts, instantly.

They create immense economic value and increase productivity.

Re:"Attention is all you need" paper digested by KptMarchewa on Sunday October 08, 2023 @01:16AM (#37808042)
It's deniable right now. Future looks bright for them, but impact _now_ is more smoke than actual effect.
Re:"Attention is all you need" paper digested by dinvlad on Monday October 09, 2023 @12:04AM (#37816830)
On top of that, they face massive lawsuits for violating existing IP etc. It's far from a proven business model indeed (heck, OpenAI isn't even profitable yet), and even further as a technology (because it is so inherently unreliable - no matter the model size).

So atm they just sell hype, and not much more.

Re:"Attention is all you need" paper digested by dzign on Saturday October 07, 2023 @05:33PM (#37805748)
You mean a Turing Award...
Re:"Attention is all you need" paper digested by akomtu on Saturday October 07, 2023 @07:17PM (#37806334)
Nobel is a vanity certificate. The author of that paper must have made more money than whatever the Nobel committee would have given to him.
Re:"Attention is all you need" paper digested by mensetmanusman on Saturday October 07, 2023 @11:01PM (#37807531)
Isn’t Nobel like $1M?