News for hackers. Stuff that matters.
Re:Mamba Explained: The State Space Model Taking On Transfor... by torginus on Monday February 26, 2024 @04:10AM (#39509121)
Is this analogous to digital filters, where Transformers are the FIR filters that operate on the history of input, and IIR filters, which take past inputs into account with an exponentially decaying importance?

There are no comments on this comment yet.