News for hackers. Stuff that matters.

A comment on RWKV: Reinventing RNNs for the Transformer Era. Parent comment

Re:RWKV: Reinventing RNNs for the Transformer Era by danielbln on Tuesday May 23, 2023 @02:13AM (#36040544)
Some loss to fidelity? Our memories are hugely lossy, reconstructed at recall based on a bunch of concepts. It's great, but it's also very lossy.
[ Parent | on HN ]
Re:RWKV: Reinventing RNNs for the Transformer Era by dcl on Tuesday May 23, 2023 @03:44AM (#36041194)
You got me.
[ Parent | on HN ]