Re:Zephyr 141B, a Mixtral 8x22B fine-tune, is now available ...
by anon373839 on Friday April 12, 2024 @06:56PM
(#40018500)
This makes sense to me. If you think about the training data, texts working through problems using formal predicate logic are likely to be correct, and much more likely to be precise about what information is (or isn’t) contained in the propositions. So if you formulate the problem in this language, you’re prompting the model to sample from patterns that are more likely to give you the result you want. Whereas if you use regular English, it could be sampling from cooking blogs or who knows what.
[ Parent
| on HN ]
There are no comments on this comment yet.