News for hackers. Stuff that matters.
Re:Accelerating Gemma 4: faster inference with multi-token p... by joakleaf on Tuesday May 05, 2026 @04:39PM (#48028186)
Seems like a pull request for vLLM was just approved a few minutes ago:

https://github.com/vllm-project/vllm/pull/41745

("Add Gemma4 MTP speculative decoding support")

There are no comments on this comment yet.