News for hackers. Stuff that matters.
Re:Transformer Attention is off by one by thomasahle on Monday July 24, 2023 @08:19PM (#36856077)
> it does not have an "ego" the way scientific papers tend to have.

What do you call it when somebody takes the time to write about "a big discovery" they've made, but don't take the time to check if somebody else already did it? It's not like it's in some forgotten paper nobody has seen. It's in Pytorch itself.

Also this: "I’m 99.44% sure that it will resolve the outlier feedback loop that’s making quantization the subject of cascades of research."

There are no comments on this comment yet.