News for hackers. Stuff that matters.
Re:Transformer Attention is off by one by mlsu on Monday July 24, 2023 @02:56PM (#36852724)
Well, I'm not so sure. It seems to me that someone could perfectly well devise an experiment based off of this (another poster chastised me for saying paper, so) blog post.

Equations are perfectly clear. I was able to follow his reasoning perfectly well.

I cannot say the same for so many papers (tm) that I've read. Mostly in a similarly computational (though non- deeplearning) applied math domain.

There are no comments on this comment yet.