Re:Small Models Have Arrived
by trucks-refinish on Thursday August 27, 2026 @10:33PM
(#49473697)
I'm able to run qwen 3.6 35b a3b with my rtx 2060 super which also has 8gb of vram. It's a very capable model, not as smart as a frontier model but it is still very useful.
I use an 6bit quant and get around 20 tokens per second.
I use an 6bit quant and get around 20 tokens per second.