News for hackers. Stuff that matters.
Re:Gemma3 – The current strongest model that fits on a singl... by pzo on Wednesday March 12, 2025 @07:54AM (#43342256)
Maybe model is sensitive to quantization, by default ollama quantize it significantly.
Re:Gemma3 – The current strongest model that fits on a singl... by tarruda on Wednesday March 12, 2025 @10:32AM (#43343683)
I tried ollama fp16 and it had the same issues.