News for hackers. Stuff that matters.
Re:DeepSeek V4 Flash 0731 by retinaros on Friday August 07, 2026 @02:34PM (#49214571)
any link to this caching tech?
Re:DeepSeek V4 Flash 0731 by LaurensBER on Friday August 07, 2026 @02:47PM (#49214723)
[Feat][Core] Add disk offloading support to SimpleCPUOffloadConnector — #49644 https://github.com/vllm-project/vllm/pull/49644

This adds disk as a tier in the HBM → CPU → Disk KV cache hierarchy.

There's also a cluster of related KV-offload FS PRs: #49225 (read/write batching, still open) and #49152 (batch store/load in C, merged Jul 28).

It's hard to say if these are similar to the approach DeepSeek takes but they definitely seem very interesting.