News for hackers. Stuff that matters.
Re:Show HN: Standalone TurboQuant KV Cache Inference by ensotrade_tech on Saturday April 04, 2026 @12:27AM (#47635739)
What does it actually do?
Re:Show HN: Standalone TurboQuant KV Cache Inference by g023 on Monday April 06, 2026 @08:30PM (#47669210)
A single file, python based, minimal/recognizable dependencies, turboquant playground, barebones af, with some easy to access globals to experiment with at top of 'run_tquant.py'. Test model is a 1.77B model that I altered by duplicating a layer in a Qwen3 1.7B model. Probably work fine with the regular Qwen3 1.7B model as well, but for right now I'm just working with my surgically altered one while I work on the script.