Re:Reformer, the Efficient Transformer
by lucidrains on Sunday January 19, 2020 @05:33PM
(#22094600)
I think what they did in the paper is to increase the chances by multiple rounds of hashing, up to 8 times. They show experimentally that 8 times was good enough to be equivalent to a regular transformer.
[ Parent
| on HN ]
There are no comments on this comment yet.