Re:Show HN: Standalone TurboQuant KV Cache Inference
by g023 on Monday April 06, 2026 @08:30PM
(#47669210)
A single file, python based, minimal/recognizable dependencies, turboquant playground, barebones af, with some easy to access globals to experiment with at top of 'run_tquant.py'. Test model is a 1.77B model that I altered by duplicating a layer in a Qwen3 1.7B model. Probably work fine with the regular Qwen3 1.7B model as well, but for right now I'm just working with my surgically altered one while I work on the script.
[ Parent
| on HN ]
There are no comments on this comment yet.