News for hackers. Stuff that matters.
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin... by DanielHB on Monday August 17, 2026 @05:36AM (#49328415)
I am very much a beginner to local LLM stuff and I find it incredibly hard to figure out how to run models optimally with the correct settings for my hardware. The number of different variations of the same model and how each quant work is super confusing as well.

When I tried to run llama.cpp directly I was getting max 9tk/s on qwen3.5-9B, then I tried LM Studio with the same model and got 77tk/s. I haven't figured out yet how to get MTP working properly in either.

Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin... by car on Monday August 17, 2026 @06:54AM (#49328981)
If you are on Mac, have a look at the Llama-macOS app. They claim sensible settings for the linked model downloads. I'd expect the authors of Llama.cpp and the Huggingface folks to know this stuff.

https://news.ycombinator.com/item?id=49328008

Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin... by tiahura on Monday August 17, 2026 @08:44AM (#49329937)
If your package manager / configurator isn’t claude code or codex, you’re wasting time.
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin... by dofm on Monday August 17, 2026 @08:56AM (#49330078)
Unless, of course, your goal is to actually understand what is going on, regardless of whether that is difficult.
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin... by blactuary on Monday August 17, 2026 @09:54AM (#49330945)
Some of us prefer to avoid Anthropic/OpenAI
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin... by throw1234567891 on Monday August 17, 2026 @10:31AM (#49331648)
Your funny.
Re:Qwen 3.8 27B is excellent, but it defaults to overthinkin... by roosterIllusi0n on Tuesday August 18, 2026 @05:08AM (#49343211)
I have had luck telling the free chatgpt my graphics card brand/vram and asking it to recommend latest qwen3.8 or gemma4 model variants. Then I pasted in my server command and ask it to optimize it. I also pasted in the token per second logs to get further tweaks. If you paste the token per second info log info back to chatgpt, you can iterate with the free chatgpt to get better settings.