Re:Disagreement Among Frontier LLMs on Real-World Fact-Checks
by kostaj on Thursday May 28, 2026 @09:39AM
(#48308820)
GPT-5.4 and Opus 4.7, specifically, agree between themselves on 65% of the claims - 95% CI 62–68%. I.e., in at least 35% of the claims, one of the two models is wrong under this 4-bucket rubric.
[ Parent
| on HN ]
Re:Disagreement Among Frontier LLMs on Real-World Fact-Checks
by TaupeRanger on Thursday May 28, 2026 @10:15AM
(#48309264)
but that's without internet search - everyone I know uses the models that search when they need to, and I'm sure GPT and Opus would agree on almost everything if 1) they searched when necessary, and 2) they were allowed to give context to their answers instead of being hamstrung to get specious "research" results.