Re:AI benchmarks are a bad joke – and LLM makers are the one...
by mbesto on Sunday November 09, 2025 @10:40AM
(#45866317)
HN members do too. Look at my comment history.
The general populace doesn't care to question how benchmarks are formulated and what their known (and unknown) limitations are.
That being said, they are likely decent proxies. For example, I think the average user isn't going to observe a noticeable difference between Claude Sonnet and OpenAI Codex.
The general populace doesn't care to question how benchmarks are formulated and what their known (and unknown) limitations are.
That being said, they are likely decent proxies. For example, I think the average user isn't going to observe a noticeable difference between Claude Sonnet and OpenAI Codex.