News for hackers. Stuff that matters.
Re:Transformer Attention is off by one by janalsncm on Monday July 24, 2023 @04:24PM (#36853708)
+1 to including code with your paper. It improves reproducibility and transparency. There’s even a well-known website dedicated to this purpose.

For the rest of it I don’t care. As long as researchers understand what’s going on, that’s what matters.

Re:Transformer Attention is off by one by worthless-trash on Monday July 24, 2023 @11:43PM (#36857593)
I'm not an academic, but some of the notation and terminology they use makes me want to hunt them down and 'clockwork orange their eyes open' until they can show me how their math is "intended" to work.

Inconsistent math notatation in papers along with vague terms in descriptions makes me so mad.