Re:TurboQuant KV Compression and SSD Expert Streaming for M5...
by daft_pink on Wednesday April 01, 2026 @04:24PM
(#47606072)
I’ve always believed local is the future. If you consider how your iPhone has a processor that is more powerful than something very large not too long ago.
[ Parent
| on HN ]
Re:TurboQuant KV Compression and SSD Expert Streaming for M5...
by aegis_camera on Wednesday April 01, 2026 @04:31PM
(#47606167)
I've ran this on an IPHONE 13 pro (6GB) memory, QWEN 3 1.7B runs good.
So local will get more intelligent for the task you want it done soon or already.