News for hackers. Stuff that matters.

A comment on Accelerating Gemma 4: faster inference with multi-token prediction drafters. Parent comment

Re:Accelerating Gemma 4: faster inference with multi-token p... by mapontosevenths on Tuesday May 05, 2026 @05:35PM (#48028922)
Flash will absolutely destroy a complex codebase. It's like a drunk junior programmer. Don't trust it with anything more complex than autocomplete.

Pro is expensive, but good. However they've decreased the pitiful stipend they used to include in even the ultra plan to the point were it's barely usable. I pivoted back to ChatGPT Pro after the recent downgrade they gave Ultra users. Googles Ultra plan cost 2.5x as much and delivers about half the usage.

[ Parent | on HN ]
Re:Accelerating Gemma 4: faster inference with multi-token p... by sureMan6 on Tuesday May 05, 2026 @06:27PM (#48029592)
Yeah I don't get the user who said Gemini is generous with the quota, I get more use out of codex with the 5 hour limits than Gemini gives me in a week
[ Parent | on HN ]
Re:Accelerating Gemma 4: faster inference with multi-token p... by chrisweekly on Tuesday May 05, 2026 @11:18PM (#48031728)
Tangent: this is one of those situations where slang is harmful to understanding. When I saw "will absolutely destroy" my first interpretation was a positive connotation. Of course further context made it clear you were being straightforward, and this isn't aimed at you. Along these lines, "drop" has become a problematic term: "Acme co dropped support for Foo" means it's EOL, but "Foo dropped today" implies it just landed. Idioms are hard enough when they don't serve as borderline autoantonyms. To wrap up this extended digression, if anyone else finds this sort of thing interesting, and could use a good laugh, check out Ismo (a standup comic from Finland who makes truly hilarious observations about English as a second language).

https://youtu.be/oGmzfjuicE0?si=nL_W75s8UDp1g-zI

https://youtu.be/jXcMoHeWaYQ?si=QMi7nEwVWvCZyzbl

[ Parent | on HN ]
Re:Accelerating Gemma 4: faster inference with multi-token p... by kridsdale1 on Wednesday May 06, 2026 @08:37AM (#48035509)
I had the same experience.
[ Parent | on HN ]
Re:Accelerating Gemma 4: faster inference with multi-token p... by psychoslave on Wednesday May 06, 2026 @01:34AM (#48032619)
> It's like a drunk junior programmer.

Thanks for the laugh. :)

[ Parent | on HN ]