Re:Transformer Attention is off by one
by worthless-trash on Monday July 24, 2023 @11:43PM
(#36857593)
I'm not an academic, but some of the notation and terminology they use makes me want to hunt them down and 'clockwork orange their eyes open' until they can show me how their math is "intended" to work.
Inconsistent math notatation in papers along with vague terms in descriptions makes me so mad.
Inconsistent math notatation in papers along with vague terms in descriptions makes me so mad.