News for hackers. Stuff that matters.
Re:Unsloth Dynamic 3.0 GGUFs by zenoprax on Wednesday August 19, 2026 @09:44PM (#49369517)
For some reason the unsloth models leave hardly any room for context. I've switched to the regular (non-unsloth) and get about 25 t/s and get about 80,000 more context tokens for the same quant.

There are no comments on this comment yet.