News for hackers. Stuff that matters.

A comment on Google ‘BigBird’ Achieves SOTA Performance on Long-Context NLP Tasks.

Re:Google ‘BigBird’ Achieves SOTA Performance on Long-Contex... by gwern on Monday August 03, 2020 @06:15PM (#24044105)
Bibliography of the various approaches to long-context Transformers: https://www.reddit.com/r/MachineLearning/comments/hxvts0/d_b...
[ Parent | on HN ]

There are no comments on this comment yet.