News for hackers. Stuff that matters.

A comment on Disagreement Among Frontier LLMs on Real-World Fact-Checks. Parent comment

Re:Disagreement Among Frontier LLMs on Real-World Fact-Checks by anilgulecha on Thursday May 28, 2026 @10:01AM (#48309094)
Disagree is such a loose/wimpy study. Add in a grounded/expected response, and then it becomes a better benchmark (because it'll force the author to actually think about choices presented to the LLM).
[ Parent | on HN ]
Re:Disagreement Among Frontier LLMs on Real-World Fact-Checks by kostaj on Thursday May 28, 2026 @10:09AM (#48309193)
Will add a human-labelled expected response and measure against it in a follow up research. This one only captures the disagreement between the models, but not which model is write/wrong.
[ Parent | on HN ]