News for hackers. Stuff that matters.
Re:Google ‘BigBird’ Achieves SOTA Performance on Long-Contex... by mdrabla on Monday August 03, 2020 @07:39PM (#24044804)
Thanks for the link - pretty good review. Totally agree with what he says about calling it SOTA. It's definitely a very interesting approach but I wouldn't put that much weight on whether it's achieved SOTA, because of the amount of compute they threw into it.

There are no comments on this comment yet.