Scalable MatMul-Free Language Modeling

Re:Scalable MatMul-Free Language Modeling by nuz on Sunday June 09, 2024 @07:35AM (#40623737)

Oh this is by the inventor of RWKV, cool

[ Parent | on HN ]

Re:Scalable MatMul-Free Language Modeling by brianflakes on Sunday June 09, 2024 @09:25AM (#40624270)

I think you might have names mixed up. Bo Peng (BlinkDL on github) is the author of RWKV, not on the authors list here.

[ Parent | on HN ]

Re:Scalable MatMul-Free Language Modeling by nuz on Sunday June 09, 2024 @10:57AM (#40624868)

Follow the github author to this project and you get to https://ruijie-zhu.github.io/ which has in the bio "I am deeply fascinated by large language models and had the privilege to be one of the authors of the RWKV large language model"

[ Parent | on HN ]