News for hackers. Stuff that matters.

A comment on Paving the way to efficient architectures: StripedHyena-7B. Parent comment

Re:Paving the way to efficient architectures: StripedHyena-7B by senseiV on Friday December 08, 2023 @08:18PM (#38577269)
They Do, the latest rwkv v5, matches mamba at 3b scale, and from the benchmarks I see, its similar to hyena
[ Parent | on HN ]

There are no comments on this comment yet.