News for hackers. Stuff that matters.
Re:Ornith-1.5: From Self-Scaffolding to Self-Improvement by kzrdude on Thursday August 20, 2026 @03:28AM (#49371515)
27B means it has 27 billion parameters, but how that translates to model size depends on the model architecture. For Qwen 3.5 architecture (same as 3.8) the native size is around 55 GB memory. So you need quantization to fit it in 32 GB.

Go here: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF

See the right hand side panel, you see a whole palette of quantizations and their respective sizes. Should give you an idea. Note that these are not the only quantizations available.

There are no comments on this comment yet.