Accelerating Gemma 4: faster inference with multi-token prediction drafters

Re:Accelerating Gemma 4: faster inference with multi-token p... by xnx on Tuesday May 05, 2026 @11:28PM (#48031803)

Have you compared Opus and Gemini to see if Gemini is any worse at planning than Opus?

[ Parent | on HN ]

Re:Accelerating Gemma 4: faster inference with multi-token p... by qingcharles on Wednesday May 06, 2026 @01:14AM (#48032462)

Yes, Gemini 3.1 Pro (High) is still inferior to Opus 4.6 (Thinking) that Google are offering, for planning. It just doesn't think things through as thoroughly as Opus. I'll use it when I've burned up all my Opus tokens and I still have planning I want to do, but I'll read the plan very carefully, whereas with Opus I'll only give it a cursory scan through.

[ Parent | on HN ]

Re:Accelerating Gemma 4: faster inference with multi-token p... by xnx on Wednesday May 06, 2026 @01:17AM (#48032488)

Good data point. I would venture 90+% of Claude users have dismissed Gemini without every trying it.

[ Parent | on HN ]