Re:Self-hosting Kimi K3: 20% more hardware cost, 20% better ...
by NitpickLawyer on Wednesday July 29, 2026 @02:03PM
(#49100879)
Kimi k3 is natively mxfp4 w/ mxfp8 activations. Since they talk about glm 5.2 running on a 8x b200s, that's likely fp8 since it wouldn't fit at bf16 (1.5TB weights alone)
[ Parent
| on HN ]