News for hackers. Stuff that matters.
Re:The $100B Megadeal Between OpenAI and Nvidia Is on Ice by nextos on Friday January 30, 2026 @10:35PM (#46833152)
Deep SSMs, including the entire S4 to Mamba saga, are a very interesting alternative to transformers. In some of my genomics use cases, Mamba has been easier to train and scale over large context windows, compared to transformers.

There are no comments on this comment yet.