News for hackers. Stuff that matters.

A comment on Mamba Explained: The State Space Model Taking On Transformers. Parent comment

Re:Mamba Explained: The State Space Model Taking On Transfor... by koayon on Sunday February 25, 2024 @02:46PM (#39504087)
Another interesting one is that the hardware isn't really optimised for Mamba yet either - ideally we'd want more of the fast SRAM so that we can store more larger hidden states efficiently
[ Parent | on HN ]

There are no comments on this comment yet.