Re:Task-Specific LLM Evals That Do and Don't Work
by potatoman22 on Monday December 09, 2024 @11:33PM
(#42373788)
Have you tested moving the "reason" field before the "class" field? That may encourage better CoT instead of having the model justify the class after it already picked it. Anecdotally, I saw a 5% boost in performance from a NER system from having the model output the entity's class at the end rather than the beginning.
[ Parent
| on HN ]
There are no comments on this comment yet.