News for hackers. Stuff that matters.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by marcyb5st on Monday July 20, 2026 @01:19PM (#48981810)
No, if you burn your model into the silicon you don't need memory as the output of a layer flows through circuitry directly into the next one. No I/O to memory of any kind. You still need a bit of memory for in flight answers, but that's it.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by quotemstr on Monday July 20, 2026 @01:31PM (#48982009)
You can pipeline in software too, and even with a dedicated circuit, you need to put weights somewhere, because you're not going to have a special partially-applied FP8 FMA unit for each of your trillion model weights.

I can accept the idea of specializing a circuit for a specific model shape, but I'm not seeing a need to specialize a circuit for the weights inside the shape.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by marcyb5st on Monday July 20, 2026 @03:14PM (#48983535)
Apparently that is what Taalas did though. Not an hardware person, so take this with a pinch of salt