Re:DeepSeek V4 Flash 0731
by retinaros on Friday August 07, 2026 @02:34PM
(#49214571)
any link to this caching tech?
[ Parent
| on HN ]
Re:DeepSeek V4 Flash 0731
by LaurensBER on Friday August 07, 2026 @02:47PM
(#49214723)
[Feat][Core] Add disk offloading support to SimpleCPUOffloadConnector — #49644
https://github.com/vllm-project/vllm/pull/49644
This adds disk as a tier in the HBM → CPU → Disk KV cache hierarchy.
There's also a cluster of related KV-offload FS PRs: #49225 (read/write batching, still open) and #49152 (batch store/load in C, merged Jul 28).
It's hard to say if these are similar to the approach DeepSeek takes but they definitely seem very interesting.