News for hackers. Stuff that matters.

A comment on MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts. Parent comment

Re:MoE-Mamba: Efficient Selective State Space Models with Mi... by anomaly72 on Tuesday January 09, 2024 @09:35PM (#38935434)
Would recommend Sasha Rush's lecture https://www.youtube.com/watch?v=dKJEpOtVgXc, it provides the intuition for state space models via linear RNNs
[ Parent | on HN ]

There are no comments on this comment yet.