News for hackers. Stuff that matters.
Re:Inkling 2 Mini by rsolva on Friday November 20, 2026 @04:35PM (#50582531)
Hm, that seems strangely slow. Qwen3.8-27B/DaisyRose-27B Q4 currently run with ~66 t/s and ~800 t/s prefill with 3 slots and about 190k kv cache. It performs really well so far.
Re:Inkling 2 Mini by jakswa on Friday November 20, 2026 @04:37PM (#50582563)
Yeah I've had 27B (dense model) up to similar speeds on this setup as well. I'll hold off to compare my speeds to others, maybe it's too early or it's particular to my setup.