News for hackers. Stuff that matters.
Re:Mistral Fine-Tune by tikhonj on Saturday May 25, 2024 @06:48AM (#40474135)
Looks like it actually changes how you do token generation to conform to a given context-free grammar. It's a way to structure how you sample from the model rather than a tweak to the prompt, so it's more efficient and guarantees that the output matches the formal grammar.

There's a reference to the paper that describes the method at the bottom of the README: https://arxiv.org/pdf/2307.09702

There are no comments on this comment yet.