Re:Kimi K3 is now #1 in the Front end Code Arena with 1679 p...
by halJordan on Friday July 17, 2026 @01:44PM
(#48950103)
A 2 bit model is still 700gbs you need to stream through.
I know we say reading is free (vs writing). But on a 2tb drive, you're doing a full drive read for every three tokens. Thats 333,000 drive reads just to fill up the context. Well, this is at least an moe model so not that terrible. But i think the point remains
I know we say reading is free (vs writing). But on a 2tb drive, you're doing a full drive read for every three tokens. Thats 333,000 drive reads just to fill up the context. Well, this is at least an moe model so not that terrible. But i think the point remains