News for hackers. Stuff that matters.

santander_cl

santander_cl on Hacker News

Re:Show HN: Standalone TurboQuant KV Cache Inference on Friday April 03, 2026 @06:48PM (#47633351)
Starred immediately.

This is exactly the kind of practical quantization work that makes running longer-context models on consumer GPUs actually feasible. Looking forward to seeing it generalized beyond the one model.Great stuff, g023.