News for hackers. Stuff that matters.
Re:Sam Altman Seeks Trillions of Dollars to Reshape Business... by cma on Friday February 09, 2024 @12:11PM (#39317297)
Will your arch work for SSMs?
Re:Sam Altman Seeks Trillions of Dollars to Reshape Business... by trsohmers on Friday February 09, 2024 @01:55PM (#39318796)
Yes; Mamba was a very easy match, with Hyena also being a good match, but could be greatly optimized with some minimal changes to the model architecture or hardware design.