Re:Mistral Fine-Tune
by tikhonj on Saturday May 25, 2024 @06:48AM
(#40474135)
Looks like it actually changes how you do token generation to conform to a given context-free grammar. It's a way to structure how you sample from the model rather than a tweak to the prompt, so it's more efficient and guarantees that the output matches the formal grammar.
There's a reference to the paper that describes the method at the bottom of the README: https://arxiv.org/pdf/2307.09702