News for hackers. Stuff that matters.
Re:'Attention is all you need' coauthor says he's 'absolutel... by rootnod3 on Friday October 24, 2025 @02:16PM (#45697494)
So, unless this went r/woosh over my head....how is current AI better than shit post-transformers? If all....old shit post-transformers are at least deterministic or open and not a randomized shitbox.

Unless I misinterpreted the post, render me confused.

Re:'Attention is all you need' coauthor says he's 'absolutel... by isoprophlex on Friday October 24, 2025 @02:25PM (#45697590)
I wasn't too clear, I think. Apologies if the wording was confusing.

People who started their NLP work (PhDs etc; industry research projects) before the LLM / transformer craze had to adapt to the new world. (Hence 'post-mass-uptake-of-transformers')

Re:'Attention is all you need' coauthor says he's 'absolutel... by rootnod3 on Saturday October 25, 2025 @01:27PM (#45705526)
Ah ok, then I did misunderstand a lot. That makes sense. And I do like the non AI based NLP work.
Re:'Attention is all you need' coauthor says he's 'absolutel... by dgacmu on Friday October 24, 2025 @02:19PM (#45697535)
I think you're misinterpreting: "with the advent of transformers, (many) people doing NLP with pre-transformers techniques had to salvage their shit"
Re:'Attention is all you need' coauthor says he's 'absolutel... by rootnod3 on Saturday October 25, 2025 @01:29PM (#45705549)
I guess. That's why I added the "unless I am mis-interpreting", still got downvoted for it because I guess it was against AI. The wording was confusing but so was my understanding of it as a non-native speaker. Shit happens.
Re:'Attention is all you need' coauthor says he's 'absolutel... by dgacmu on Sunday October 26, 2025 @10:49AM (#45712354)
I agree that the wording was a bit confusing (as a native speaker).
Re:'Attention is all you need' coauthor says he's 'absolutel... by numpad0 on Friday October 24, 2025 @02:33PM (#45697691)
There's no post-transformer tech. There are lots of NLP tasks that you can now, just, prompt an LLM to do.
Re:'Attention is all you need' coauthor says he's 'absolutel... by isoprophlex on Friday October 24, 2025 @02:49PM (#45697852)
Yeah unclear wording; see the sibling comment also. I meant "the tech we have now", in the era after "attention is all you need"