Qwen 3.6 27B is the sweet spot for local development

Re:Qwen 3.6 27B is the sweet spot for local development by fumeux_fume on Monday June 29, 2026 @02:26PM (#48723159)

I suspect with those specs, you're not in the game right now for reliably using local models for code generation. The easiest way in is a MacBook with at least 32GB of RAM. This should be able to run a 4bit quantization of qwen 3.6 using the MLX format really well.

[ Parent | on HN ]

Re:Qwen 3.6 27B is the sweet spot for local development by Otternonsenz on Monday June 29, 2026 @03:10PM (#48723731)

Now that I’m dipping more into this space, am gonna see what I can upgrade with the motherboard I have, but RAM pricing as it is, I’ll need to be smart about when I upgrade.

I very much appreciate the frank response, as it makes me feel less defeated at knowing my understanding of how it should work is not the full issue, hahaha

[ Parent | on HN ]

Re:Qwen 3.6 27B is the sweet spot for local development by fumeux_fume on Monday June 29, 2026 @03:41PM (#48724110)

M series macs are usually used for running these LLMs locally because the GPU and CPU share the same pool of RAM at very low latency. If you upgrade your RAM on a different kind of chipset without the Unified Memory Architecture, then it'll be much slower to produce all the tokens you need. Just another data point to add to your upgrade equation.

[ Parent | on HN ]