News for hackers. Stuff that matters.
Re:XLSTM: Extended Long Short-Term Memory by lucidrains on Wednesday May 08, 2024 @10:37AM (#40298605)
Re:XLSTM: Extended Long Short-Term Memory by Der_Einzige on Wednesday May 08, 2024 @07:16PM (#40303676)
So does anything do proper state tracking? And don’t point to the OP since very often purportedly better new architectures end up being basically vaporware (like mamba or rkwv, which still don’t have good quality pre trained models yet)
Re:XLSTM: Extended Long Short-Term Memory by impossiblefork on Thursday May 09, 2024 @06:13AM (#40306731)
How do you mean vaporware?

Surely whether a big model using a certain system exists is only a matter of the choices of those with sufficient resources to train it. That's only a matter of their beliefs, not about actual model performance.