News for hackers. Stuff that matters.

A comment on Accelerating Gemma 4: faster inference with multi-token prediction drafters. Parent comment

Re:Accelerating Gemma 4: faster inference with multi-token p... by fragmede on Wednesday May 06, 2026 @03:23AM (#48033293)
Well, the TPUs they're running on don't have branch prediction, so that had to end up somewhere in the stack.
[ Parent | on HN ]

There are no comments on this comment yet.