News for hackers. Stuff that matters.
Re:Accelerating Gemma 4: faster inference with multi-token p... by moffkalast on Tuesday May 05, 2026 @04:55PM (#48028426)
The 31B is surprisingly fast too, for a dense model. Runs tg at least twice as fast as it ought to on my machine when compared to other 30B, probably due to the hybrid attention I guess. Ingestion is somewhat slower though.

There are no comments on this comment yet.