News for hackers. Stuff that matters.
Re:GLM-4.7: Advancing the Coding Capability by CuriouslyC on Monday December 22, 2025 @03:12PM (#46358441)
We're not gonna see significant model shrinkage until the money tap dries up. Between now and then, we'll see new benchmarks/evals that push the holes in model capabilities in cycles as they saturate each new round.
Re:GLM-4.7: Advancing the Coding Capability by lanthissa on Monday December 22, 2025 @03:26PM (#46358617)
isn't gemini 3 flash already model shrinkage that does well in coding?
Re:GLM-4.7: Advancing the Coding Capability by hedgehog on Monday December 22, 2025 @03:29PM (#46358669)
Smaller open-weights models are also improving noticeably (like Qwen3 Coder 30B), the improvements are happening at all sizes.
Re:GLM-4.7: Advancing the Coding Capability by cmrdporcupine on Monday December 22, 2025 @03:34PM (#46358720)
Devstral Small 24b looks promising as something I want to try fine tuning on DSLs, etc. and then embedding in tooling.
Re:GLM-4.7: Advancing the Coding Capability by hedgehog on Monday December 22, 2025 @06:43PM (#46360630)
I haven't tried it yet, but yes. Qwen3 Next 80B works decently in my testing, and fast. I had mixed results with the new Nemotron, but it and the new Qwen models are both very fast to run.
Re:GLM-4.7: Advancing the Coding Capability by mark_l_watson on Tuesday December 23, 2025 @07:51AM (#46364938)
Same experience: on my old M2 Mac with just 32B of memory both Qwen 3 30B and the new Nemotron models are very useful for coding if I prepare a one-shot prompt with directions and relevant code. I don’t like them for agentic coding tools. I have mentioned this elsewhere: it is deeply satisfying to mix local model use with commercial APIs and services.
Re:GLM-4.7: Advancing the Coding Capability by Imustaskforhelp on Monday December 22, 2025 @04:28PM (#46359320)
How much billion parameter model is gemini 3 flash, I can't seem to find info about it online.
Re:GLM-4.7: Advancing the Coding Capability by skippyboxedhero on Monday December 22, 2025 @09:29PM (#46361744)
Xiaomi, Nvidia Nemotron, Minimax, lots of other smaller ones too. There are massive economic incentives to shrink models because they can be provided faster and at lower cost.

I think even with the money going in, there has to be some revenue supporting that development somewhere. And users are now looking at the cost. I have been using Anthropic Max for most of this year after checking out some of these other models, it is clearly overpriced (I would also say their moat of Claude Code has been breached). And Anthropic's API pricing is completely crazy when you use some of the paradigms that they suggest (agents/commands/etc) i.e. token usage is going up so efficient models are driving growth.

Re:GLM-4.7: Advancing the Coding Capability by naasking on Tuesday December 23, 2025 @09:15AM (#46365475)
> We're not gonna see significant model shrinkage until the money tap dries up.

I'm not sure about that. Microsoft has been doing great work on "1-bit" LLMs, and dropping the memory requirements would significantly cut down on operating costs for the frontier players.