News for hackers. Stuff that matters.
Re:RWKV: Reinventing RNNs for the Transformer Era by RC_ITR on Thursday May 25, 2023 @12:48PM (#36073023)
How can something recurrent be parallelized?

> the equations of the RWKV model enable computational parallelization, provided that the sequence is predetermined.

And sure, this is the core concept of self attention, no?

There are no comments on this comment yet.