News for hackers. Stuff that matters.
Re:Task-Specific LLM Evals That Do and Don't Work by andai on Tuesday December 10, 2024 @10:05AM (#42377521)
Does it still work if the class field is output before the reason?
Re:Task-Specific LLM Evals That Do and Don't Work by jacobr1 on Tuesday December 10, 2024 @12:06PM (#42378732)
Yes. But, reason first did work (very slightly) better.