News for hackers. Stuff that matters.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by marcyb5st on Monday July 20, 2026 @01:17PM (#48981763)
You don't need memory because the output of the previous layer flows directly into the input gates of the next. So no I/O to/from HBM or similar

You still need some memory for the context, in flight answers, ... but not for the model weights and for the output of the intermediate layers. I found taalas demo here: https://chatjimmy.ai/

There are no comments on this comment yet.