News for hackers. Stuff that matters.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by badsectoracula on Saturday November 14, 2026 @02:17AM (#50494797)
FWIW depending on what exactly you want to review something smaller like Gemma 4 E4B would be much faster. On my 7yo 3700X, llama.cpp runs Gemma 4 E4B UD-Q4_K_XL with a 131k context (context size doesn't seem to make much of a difference in speed) at ~10-15 tps (using MTP draft).

I'm mainly using it when i need some simple stuff and Qwen 3.8 27B is already occupied in the background :-P

Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by 3eb7988a1663 on Saturday November 14, 2026 @10:20AM (#50497727)
I kind of like the slow process, it forces me to be deliberate and not lean on the tooling as a crutch. I don't write that much, so having to wait a day is kind of like having your final work ready to review by a human editor.

Plus, using a bigger model makes me feel a little better that I am not taking a hit on quality when I do not even care about the turnaround time.