Re:OpenAI claims Gold-medal performance at IMO 2025
by btilly on Sunday July 20, 2025 @12:13AM
(#44621911)
To the nearest 5%, for percentages in that middle range. It is not just 16% -> 15%. But also 46% -> 45%.
[ Parent
| on HN ]
Re:OpenAI claims Gold-medal performance at IMO 2025
by dataflow on Sunday July 20, 2025 @12:23AM
(#44621953)
Yes so this confirms my point rather than refuting it...
Re:OpenAI claims Gold-medal performance at IMO 2025
by btilly on Sunday July 20, 2025 @02:58AM
(#44622620)
It seems that you reversed your point then. You said before:
Even before I read your comment I thought that 5% precision is useful but 1% precision is a silly turn-off, unless that 1% is near the 0% or 100% boundary.
However what I am saying is that there is real data, involving real predictions, by real people, that demonstrates that there is a measurable statistical loss of accuracy in their predictions if you round off those percentages.
This doesn't mean that any individual prediction is accurate to that percent. But it happens often enough that the last percent really does contain real value.