Re:Fixing Tool-Call Accuracy in vLLM
by embedding-shape on Tuesday October 27, 2026 @09:44AM
(#50259220)
> when it can't be found by scraping a web page?
This is the very purpose of those tokens! The reason they're like that, is because you won't encounter it in random content, so during training, you can put them where you want them to end up at prediction time.
This is the very purpose of those tokens! The reason they're like that, is because you won't encounter it in random content, so during training, you can put them where you want them to end up at prediction time.