Re:Ask HN: What's the best paper you've read in 2020?
by m3at on Tuesday December 08, 2020 @08:16PM
(#25354082)
You raise an important point. The proposed solutions are too many to enumerate, but if I had to pick just one currently I would go for "Rethinking Attention with Performers" [1]. The research into making transformer better for higher dimensional inputs is also moving fast and is worth following.
[1] https://arxiv.org/abs/2009.14794