Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update
by jedbrooke on Saturday November 14, 2026 @01:01AM
(#50494450)
I’ve been using Bonsai 2 (also based off of Qwen3.8 27B) on my mac mini in this way (using pizza-bot for the harness). In my case I’ve been using more for deep web search type stuff. It’s been a nice workflow to kick off a request in the evening and come back to a 1 page report on it the next morning.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update
by alex43578 on Saturday November 14, 2026 @03:04AM
(#50495043)
It’s fun, but it’s just so tough to see the value when the same research report via ChatGPT is done in 5 minutes and likely higher quality, for less than a dollar a day.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update
by badsectoracula on Saturday November 14, 2026 @02:17AM
(#50494797)
FWIW depending on what exactly you want to review something smaller like Gemma 4 E4B would be much faster. On my 7yo 3700X, llama.cpp runs Gemma 4 E4B UD-Q4_K_XL with a 131k context (context size doesn't seem to make much of a difference in speed) at ~10-15 tps (using MTP draft).
I'm mainly using it when i need some simple stuff and Qwen 3.8 27B is already occupied in the background :-P
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update
by 3eb7988a1663 on Saturday November 14, 2026 @10:20AM
(#50497727)
I kind of like the slow process, it forces me to be deliberate and not lean on the tooling as a crutch. I don't write that much, so having to wait a day is kind of like having your final work ready to review by a human editor.
Plus, using a bigger model makes me feel a little better that I am not taking a hit on quality when I do not even care about the turnaround time.
Not compatible with vibe coding, but if you want a local tool to review content, it is possible today.