News for hackers. Stuff that matters.
Re:Disagreement Among Frontier LLMs on Real-World Fact-Checks by fumeux_fume on Thursday May 28, 2026 @11:26AM (#48310355)
This is a good pattern because it would allow all the models to "think" a bit before giving an answer even if they don't have reasoning or thinking turn on. Just make sure you have the reasoning output before the final answer. A mistake I see all the time is having the answer outputted first then the explanation after which leaves more room for models to rationalize bad answers.

Good pattern: {"explanation": <short explanation for your answer>, "answer": <your final answer: true|false|i don't know>}

Bad pattern: {"answer": <your answer here>, "explanation": <short explanation for your answer>}

There are no comments on this comment yet.