News for hackers. Stuff that matters.
Re:Qwen3: Think deeper, act faster by daemonologist on Monday April 28, 2025 @11:08PM (#43828366)
Yes, it's more a rule of thumb than napkin math I suppose. The difference allows space for the KV cache which scales with both model size and context length, plus other bits and bobs like multimodal encoders which aren't always counted into the nameplate model size.

There are no comments on this comment yet.