Re:'Attention is all you need' coauthor says he's 'absolutel...
by isoprophlex on Friday October 24, 2025 @02:25PM
(#45697590)
I wasn't too clear, I think. Apologies if the wording was confusing.
People who started their NLP work (PhDs etc; industry research projects) before the LLM / transformer craze had to adapt to the new world. (Hence 'post-mass-uptake-of-transformers')
Re:'Attention is all you need' coauthor says he's 'absolutel...
by rootnod3 on Saturday October 25, 2025 @01:27PM
(#45705526)
Ah ok, then I did misunderstand a lot. That makes sense. And I do like the non AI based NLP work.
Re:'Attention is all you need' coauthor says he's 'absolutel...
by dgacmu on Friday October 24, 2025 @02:19PM
(#45697535)
I think you're misinterpreting: "with the advent of transformers, (many) people doing NLP with pre-transformers techniques had to salvage their shit"
Re:'Attention is all you need' coauthor says he's 'absolutel...
by rootnod3 on Saturday October 25, 2025 @01:29PM
(#45705549)
I guess. That's why I added the "unless I am mis-interpreting", still got downvoted for it because I guess it was against AI. The wording was confusing but so was my understanding of it as a non-native speaker. Shit happens.
Re:'Attention is all you need' coauthor says he's 'absolutel...
by dgacmu on Sunday October 26, 2025 @10:49AM
(#45712354)
I agree that the wording was a bit confusing (as a native speaker).
Re:'Attention is all you need' coauthor says he's 'absolutel...
by numpad0 on Friday October 24, 2025 @02:33PM
(#45697691)
There's no post-transformer tech. There are lots of NLP tasks that you can now, just, prompt an LLM to do.
Re:'Attention is all you need' coauthor says he's 'absolutel...
by isoprophlex on Friday October 24, 2025 @02:49PM
(#45697852)
Yeah unclear wording; see the sibling comment also. I meant "the tech we have now", in the era after "attention is all you need"
Unless I misinterpreted the post, render me confused.