Re:Better and Faster Large Language Models via Multi-Token P...
by faabian on Wednesday May 01, 2024 @06:02AM
(#40221329)
Exactly, but there is also a rejection sampling based method for speculative sampling: https://arxiv.org/abs/2302.01318
[ Parent
| on HN ]
There are no comments on this comment yet.