Re:Disagreement Among Frontier LLMs on Real-World Fact-Checks
by kostaj on Thursday May 28, 2026 @11:18AM
(#48310209)
Good idea about publishing inter-model variance data! Will include in the next version.
Even if we put aside the two middle buckets (Mostly True and Misleading), that are somewhat subject to interpretation and hedging: On 21% of the claims still at least two models provide polar-opposite verdicts (one model saying True, and another saying False)
[ Parent
| on HN ]
Re:Disagreement Among Frontier LLMs on Real-World Fact-Checks
by vlovich123 on Thursday May 28, 2026 @11:25AM
(#48310324)
Of those 21% how many are time-dependent questions that are past the model’s training and requires research to verify? Like the “did Ukraine attack Russian in the past week” question?