News for hackers. Stuff that matters.
Re:Mamba: Linear-Time Sequence Modeling with Selective State... by junipertea on Monday December 04, 2023 @04:15PM (#38523172)
It corresponds to the paper formulas as a courtesy. While descriptive comments or function signature might be nicer, it still is reasonably easy to follow along from the paper description! (Although, most of the complexity is hidden away in selective_scan_cuda.fwd())
Re:Mamba: Linear-Time Sequence Modeling with Selective State... by triyambakam on Monday December 04, 2023 @04:19PM (#38523245)
Aha, thanks, that is helpful. Any chance you know of a guide that walks through a paper and code side by side?
Re:Mamba: Linear-Time Sequence Modeling with Selective State... by ttul on Tuesday December 05, 2023 @10:06AM (#38531762)
Hailing Jeremy Howard and his team at Fast.ai to make it so!
Re:Mamba: Linear-Time Sequence Modeling with Selective State... by telotortium on Monday December 04, 2023 @07:27PM (#38525378)