Re:Mamba: Linear-Time Sequence Modeling with Selective State...
by eli_gottlieb on Monday December 04, 2023 @07:30PM
(#38525408)
Am I understanding correctly that Mamba SSM's can be used for autoregressive sequence modeling, on both continuous and discrete data?
[ Parent
| on HN ]
Re:Mamba: Linear-Time Sequence Modeling with Selective State...
by ttul on Monday December 04, 2023 @11:06PM
(#38526981)
The paper claims that Mamba outperforms Transformers on modeling audio waveforms. Once a signal gets into a computer, it is technically always discrete, but I think what you’re referring to here is the ability to model continuous signals like audio and discrete data such as written language. Am I reading you right?
Re:Mamba: Linear-Time Sequence Modeling with Selective State...
by eli_gottlieb on Tuesday December 05, 2023 @02:08PM
(#38535476)
Yes I am indeed talking about that distinction.