Re:Accelerating Gemma 4: faster inference with multi-token p...
by ActorNightly on Wednesday May 06, 2026 @11:41PM
(#48045155)
Qwen without thinking is just as fast. I have 4 parameter settings based on recommendation. If you want a good coding problem, the thinking coding mode works well, but takes a while to arrive at an answer. If you want faster turn around time, instruction mode works without thinking.
[ Parent
| on HN ]
There are no comments on this comment yet.