News for hackers. Stuff that matters.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by rdslw on Saturday November 14, 2026 @04:00AM (#50495339)
how to best run your 27G v3.1 quants on recent mac hardware with 32-64gb of ram. mlx etc. ?

what would you recommend re: software stack for best pp/tg overall performance?

Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by danielhanchen on Saturday November 14, 2026 @04:05AM (#50495356)
Oh llama.cpp has massively improved so it should function well! We're also making MLX faster soon!
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by rdslw on Saturday November 14, 2026 @10:06AM (#50497603)
look forward it. thank you for your work on unsloth!
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by regexorcist on Saturday November 14, 2026 @11:36AM (#50498361)
Check out kapitsa for mac.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by logicalmind on Saturday November 14, 2026 @01:23PM (#50499402)
If you're looking to run something from the Qwen family, you should jump right to Splash. It's faster than mlx or llama. You can run the unsloth gguf's.

https://github.com/incoai/splash