News for hackers. Stuff that matters.
Re:Google ‘BigBird’ Achieves SOTA Performance on Long-Contex... by codekansas on Monday August 03, 2020 @06:08PM (#24044036)
This seems pretty similar to the Longformer, and the performance is not that much better. Is the only difference the random attention?

There are no comments on this comment yet.