News for hackers. Stuff that matters.

A comment on Accelerating Gemma 4: faster inference with multi-token prediction drafters. Parent comment

Re:Accelerating Gemma 4: faster inference with multi-token p... by prodigycorp on Wednesday May 06, 2026 @12:12AM (#48032087)
This used to be the case, but the changes last month have rendered the Gemini Pro plan completely unusable.
[ Parent | on HN ]
Re:Accelerating Gemma 4: faster inference with multi-token p... by rjh29 on Wednesday May 06, 2026 @02:52AM (#48033107)
For me the sudden drop in quality happened a few months ago, and now it's back to being good again.

Likely there's a lot of dynamic tweaking of model quality. Rate limits are still fine for me at least.

[ Parent | on HN ]