News for hackers. Stuff that matters.
Re:I ran Gemma 4 as a local model in Codex CLI by segmondy on Monday April 13, 2026 @09:23AM (#47751618)
"The reason I had not done this before is that local models could not call tools. "

Rubbish, we have been calling tools locally for 2 years, and it's very false that gemma3 scored under 7% in tool calling. Hell, I was getting at least 75% tool calling with llama3.3

Re:I ran Gemma 4 as a local model in Codex CLI by StrLght on Monday April 13, 2026 @11:21AM (#47753312)
I was also surprised by this sentence. It sounds like this is the author's first attempt at running models locally.

Or maybe the author has been running heavily quantized small models all that time — Gemma 4 gguf he's using is Q4 and only 16 GB. In my experience quants like this tend to perform much worse.

Re:I ran Gemma 4 as a local model in Codex CLI by girvo on Monday April 13, 2026 @10:06AM (#47752189)
This entire article reads like AI slop anyway.

I also recommend anyone with a GB10 device to go try out the spark-vllm-docker setup, and check the Nvidia GB10 forums for the recently released optimised Qwen 3.5 122B A10B setup: 50tk/s is quite impressive for a decent local model!

Re:I ran Gemma 4 as a local model in Codex CLI by nphard85 on Monday April 13, 2026 @04:47PM (#47757609)
To be fair, the author does mention the huge difference between Gemma 3 and Gemma 4 on Tau function calling benchmark.