anomaly72
Re:MoE-Mamba: Efficient Selective State Space Models with Mixture of E...
on Tuesday January 09, 2024 @09:35PM (#38935434)
Would recommend Sasha Rush's lecture https://www.youtube.com/watch?v=dKJEpOtVgXc, it provides the intuition for state space models via linear RNNs