News for hackers. Stuff that matters.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by 3eb7988a1663 on Saturday November 14, 2026 @12:19AM (#50494245)
As an experiment I took, not this current quant, of Qwen 3.8 27B and had it analyze some of my writing in CPU-only mode with llamacpp. Tried a Q4 and Q5. It was dreadfully slow, but you fire that off before bed, and you can get results the next day. This was a ~6000 word markdown file, took maybe 10 minutes before it started generating anything at all, but then it just cranks away. I would need to tune down the default thinking intensity, but it otherwise did the job.

Not compatible with vibe coding, but if you want a local tool to review content, it is possible today.

Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by jedbrooke on Saturday November 14, 2026 @01:01AM (#50494450)
I’ve been using Bonsai 2 (also based off of Qwen3.8 27B) on my mac mini in this way (using pizza-bot for the harness). In my case I’ve been using more for deep web search type stuff. It’s been a nice workflow to kick off a request in the evening and come back to a 1 page report on it the next morning.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by alex43578 on Saturday November 14, 2026 @03:04AM (#50495043)
It’s fun, but it’s just so tough to see the value when the same research report via ChatGPT is done in 5 minutes and likely higher quality, for less than a dollar a day.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by badsectoracula on Saturday November 14, 2026 @02:17AM (#50494797)
FWIW depending on what exactly you want to review something smaller like Gemma 4 E4B would be much faster. On my 7yo 3700X, llama.cpp runs Gemma 4 E4B UD-Q4_K_XL with a 131k context (context size doesn't seem to make much of a difference in speed) at ~10-15 tps (using MTP draft).

I'm mainly using it when i need some simple stuff and Qwen 3.8 27B is already occupied in the background :-P

Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by 3eb7988a1663 on Saturday November 14, 2026 @10:20AM (#50497727)
I kind of like the slow process, it forces me to be deliberate and not lean on the tooling as a crutch. I don't write that much, so having to wait a day is kind of like having your final work ready to review by a human editor.

Plus, using a bigger model makes me feel a little better that I am not taking a hit on quality when I do not even care about the turnaround time.