Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by quotemstr on Monday July 20, 2026 @07:04PM
(#48985981)
Is the mask ROM really going to be worth it over Carmack's high-bandwidth-flash concept? I mean, sure, I could be convinced I guess, but it's not obvious.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by Tuna-Fish on Tuesday July 21, 2026 @04:42PM
(#48998002)
Yes.
Not because rom is better than flash, but because the critical part is distributing the memory with the compute. Mask ROM is just the densest way of embedding memory with logic. Instead of having a large pool of memory connected to the separate execution units with a bus, each execution unit locally has the rom that it uses. Data movement is >90% of energy use in modern ai accelerators, removing it as far as practical is how they get performance and silicon and energy efficiency.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by tacitusarc on Tuesday July 21, 2026 @10:02PM
(#49000937)
But attention/KV cache is the heavy bit in long context lengths which is what everyone needs…
If they designed this right, it means that once they have a model, so long as they keep the hyperparameters fixed they can change the weights much faster than it takes to spin up a completely new chip, essentially at a cost of doing a minor revision.