Re:Unsloth Dynamic 3.0 GGUFs
by zenoprax on Wednesday August 19, 2026 @09:44PM
(#49369517)
For some reason the unsloth models leave hardly any room for context. I've switched to the regular (non-unsloth) and get about 25 t/s and get about 80,000 more context tokens for the same quant.
[ Parent
| on HN ]
There are no comments on this comment yet.