News for hackers. Stuff that matters.

A comment on Accelerating Gemma 4: faster inference with multi-token prediction drafters. Parent comment

Re:Accelerating Gemma 4: faster inference with multi-token p... by 8note on Tuesday May 05, 2026 @08:38PM (#48030695)
ive got the one that came with my phone.

its gotten much better on token limits and up time.

i recently reran a screenshot heavy task that i had last run in january, and it was able to keep running overnight and maybe peaked at 40% quota at any time, vs last time id need to resume it maybe twice to get the task to completion

[ Parent | on HN ]
Re:Accelerating Gemma 4: faster inference with multi-token p... by dr_kiszonka on Wednesday May 06, 2026 @01:49AM (#48032700)
Was this a script using the API or something you asked Gemini CLI to do? I burn through Gemini CLI and Antigravity daily quotas in 2 hours on the $20 plan (AI Pro). Or maybe you used an older flash model?

I am asking because I am very frustrated with the new quotas and I am hoping to get more mileage out of my subscription.

[ Parent | on HN ]