Re:What Happened to Bert and T5?
by vintermann on Friday July 19, 2024 @05:04PM
(#41011213)
For people like me who gave up trying to follow Arxiv ML papers 3+ years ago, articles like these are gold. I would love a Youtube channel or blog which does retrospectives on "big" papers of the last decade (those that everyone paid attention to at the time) and look at where the ideas are today.
[ Parent
| on HN ]
All you need is uninterrupted attention
Maybe one needs additional heads of attention?
Flash attention
yes. my pics of youtubers (some news, but some paper reviews too) here https://github.com/swyxio/ai-notes/blob/main/Resources/Good%...