News for hackers. Stuff that matters.
Re:Better and Faster Large Language Models via Multi-Token P... by faabian on Wednesday May 01, 2024 @06:02AM (#40221329)
Exactly, but there is also a rejection sampling based method for speculative sampling: https://arxiv.org/abs/2302.01318

There are no comments on this comment yet.