Re:Kimi K3-256k
by DelightOne on Saturday August 01, 2026 @12:58PM
(#49136129)
Prefix caching automatically detects priorly read tokens -> more fained grained checkpoints then. With prefix caching you don't have to ask for a checkpoint, its automatic.
One way or the other, a prefix is saved. Only the additional info how to continue is new.
One way or the other, a prefix is saved. Only the additional info how to continue is new.