News for hackers. Stuff that matters.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by quotemstr on Monday July 20, 2026 @01:31PM (#48982009)
You can pipeline in software too, and even with a dedicated circuit, you need to put weights somewhere, because you're not going to have a special partially-applied FP8 FMA unit for each of your trillion model weights.

I can accept the idea of specializing a circuit for a specific model shape, but I'm not seeing a need to specialize a circuit for the weights inside the shape.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by marcyb5st on Monday July 20, 2026 @03:14PM (#48983535)
Apparently that is what Taalas did though. Not an hardware person, so take this with a pinch of salt