Re:Inkling 2 Mini
by rsolva on Friday November 20, 2026 @04:35PM
(#50582531)
Hm, that seems strangely slow. Qwen3.8-27B/DaisyRose-27B Q4 currently run with ~66 t/s and ~800 t/s prefill with 3 slots and about 190k kv cache. It performs really well so far.
[ Parent
| on HN ]