News for hackers. Stuff that matters.
Re:'Attention is all you need' coauthor says he's 'absolutel... by hammock on Friday October 24, 2025 @01:42PM (#45697135)
> I think the valuable idea is probabilistic graphical models- of which transformers is an example- combining probability with sequences, or with trees and graphs- is likely to continue to be a valuable area

I agree. Causal inference and symbolic reasoning would SUPER juicy nuts to crack , more so than what we got from transformers.

Re:'Attention is all you need' coauthor says he's 'absolutel... by nickpsecurity on Saturday October 25, 2025 @09:06AM (#45703601)
In Explainable AI and hybrid studies, many people are combining multiple methods with one doing unsupervised learning or generation but training or analyzed by an explainable model. Try that.