hh1
Re:XLSTM: Extended Long Short-Term Memory
on Thursday May 09, 2024 @04:36AM (#40306338)
When you talk about "c" or "scalar memory" in the paper, does that refer to a single unit in the vector usually referred to as c?
So in mLSTM, each unit of the vector c is now a matrix (so a 3d tensor)? And we refer to each matrix as a head?
Having a bit of issue understanding this fundamental part