News for hackers. Stuff that matters.
Re:Transformer Attention is off by one by nico on Monday July 24, 2023 @02:55PM (#36852721)
It would be amazing if academia started replacing papers with videos + code

I want to see: an explainer of the science/ideas/experiments/hipothesis

And instructions on how to reproduce the experiments/results

Some YouTubers are going in this direction

Re:Transformer Attention is off by one by janalsncm on Monday July 24, 2023 @04:24PM (#36853708)
+1 to including code with your paper. It improves reproducibility and transparency. There’s even a well-known website dedicated to this purpose.

For the rest of it I don’t care. As long as researchers understand what’s going on, that’s what matters.

Re:Transformer Attention is off by one by worthless-trash on Monday July 24, 2023 @11:43PM (#36857593)
I'm not an academic, but some of the notation and terminology they use makes me want to hunt them down and 'clockwork orange their eyes open' until they can show me how their math is "intended" to work.

Inconsistent math notatation in papers along with vague terms in descriptions makes me so mad.

Re:Transformer Attention is off by one by herval on Monday July 24, 2023 @07:50PM (#36855835)
oh god, please, no more videos...
Re:Transformer Attention is off by one by saiojd on Tuesday July 25, 2023 @02:43AM (#36858810)
Most papers already have code, and videos are very common.
Re:Transformer Attention is off by one by nico on Tuesday July 25, 2023 @05:57PM (#36870171)
Videos showing some result, but almost never a video of someone explaining the thing they are doing

When they include good videos, they really stand out