News for hackers. Stuff that matters.

A comment on Accelerating Gemma 4: faster inference with multi-token prediction drafters. Parent comment

Re:Accelerating Gemma 4: faster inference with multi-token p... by mike_hearn on Wednesday May 06, 2026 @04:58AM (#48033937)
You can disaggregate though. So draft models can run on cheaper hardware with less RAM, saving time on the more expensive machines with more RAM.
[ Parent | on HN ]

There are no comments on this comment yet.