News for hackers. Stuff that matters.
Re:Reformer, the Efficient Transformer by lucidrains on Sunday January 19, 2020 @05:33PM (#22094600)
I think what they did in the paper is to increase the chances by multiple rounds of hashing, up to 8 times. They show experimentally that 8 times was good enough to be equivalent to a regular transformer.

There are no comments on this comment yet.