News for hackers. Stuff that matters.
Re:Task-Specific LLM Evals That Do and Don't Work by potatoman22 on Monday December 09, 2024 @11:33PM (#42373788)
Have you tested moving the "reason" field before the "class" field? That may encourage better CoT instead of having the model justify the class after it already picked it. Anecdotally, I saw a 5% boost in performance from a NER system from having the model output the entity's class at the end rather than the beginning.

There are no comments on this comment yet.