News for hackers. Stuff that matters.

A comment on Accelerating Gemma 4: faster inference with multi-token prediction drafters. Parent comment

Re:Accelerating Gemma 4: faster inference with multi-token p... by rjh29 on Wednesday May 06, 2026 @02:47AM (#48033069)
If you use the Pro model, it can handle fairly broad prompts. Flash is very basic (no thinking)
[ Parent | on HN ]
Re:Accelerating Gemma 4: faster inference with multi-token p... by asdfasgasdgasdg on Wednesday May 06, 2026 @09:49AM (#48036239)
Sure, but with the $15/mo plan you run out of pro so fast that I prefer not to rely on it. I'll do broader prompts in two years when the cheap models are as smart as the frontier models are today.
[ Parent | on HN ]