Re:Google ‘BigBird’ Achieves SOTA Performance on Long-Contex...
by mdrabla on Monday August 03, 2020 @07:39PM
(#24044804)
Thanks for the link - pretty good review.
Totally agree with what he says about calling it SOTA. It's definitely a very interesting approach but I wouldn't put that much weight on whether it's achieved SOTA, because of the amount of compute they threw into it.
[ Parent
| on HN ]
There are no comments on this comment yet.