News for hackers. Stuff that matters.
Re:XLSTM: Extended Long Short-Term Memory by korbip on Wednesday May 08, 2024 @04:45AM (#40295734)
Thank you! I can say that it is not really a diminishing factor at the scales reported in the paper. So, xLSTM[7:1] is pretty much on par with xLSTM[1:0] in speed. We show that it is helpful on toy tasks, and it shows even better sequence extrapolation performance, so yes.

There are no comments on this comment yet.