News for hackers. Stuff that matters.
Re:Ask HN: What's the best paper you've read in 2020? by m3at on Tuesday December 08, 2020 @08:16PM (#25354082)
You raise an important point. The proposed solutions are too many to enumerate, but if I had to pick just one currently I would go for "Rethinking Attention with Performers" [1]. The research into making transformer better for higher dimensional inputs is also moving fast and is worth following.

[1] https://arxiv.org/abs/2009.14794

There are no comments on this comment yet.