Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin...
by car on Monday August 17, 2026 @06:54AM
(#49328981)
If you are on Mac, have a look at the Llama-macOS app. They claim sensible settings for the linked model downloads. I'd expect the authors of Llama.cpp and the Huggingface folks to know this stuff.
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin...
by tiahura on Monday August 17, 2026 @08:44AM
(#49329937)
If your package manager / configurator isn’t claude code or codex, you’re wasting time.
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin...
by dofm on Monday August 17, 2026 @08:56AM
(#49330078)
Unless, of course, your goal is to actually understand what is going on, regardless of whether that is difficult.
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin...
by blactuary on Monday August 17, 2026 @09:54AM
(#49330945)
Some of us prefer to avoid Anthropic/OpenAI
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin...
by throw1234567891 on Monday August 17, 2026 @10:31AM
(#49331648)
Your funny.
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin...
by roosterIllusi0n on Tuesday August 18, 2026 @05:08AM
(#49343211)
I have had luck telling the free chatgpt my graphics card brand/vram and asking it to recommend latest qwen3.8 or gemma4 model variants. Then I pasted in my server command and ask it to optimize it. I also pasted in the token per second logs to get further tweaks. If you paste the token per second info log info back to chatgpt, you can iterate with the free chatgpt to get better settings.
When I tried to run llama.cpp directly I was getting max 9tk/s on qwen3.5-9B, then I tried LM Studio with the same model and got 77tk/s. I haven't figured out yet how to get MTP working properly in either.