Re:DeepSeek-v3.1-Terminus
by Jgoauh on Monday September 22, 2025 @10:10AM
(#45333716)
have you tried
https://artificialanalysis.ai/
[ Parent
| on HN ]
Dumb collation of benchmarks that the big labs are essentially training on. Livebench.ai is the industry standard - non contaminated, new questions every few months.
Re:DeepSeek-v3.1-Terminus
by IgorPartola on Monday September 22, 2025 @11:31AM
(#45334853)
Thanks! Are the scores in some way linear here? As in, if model A is rated at 25 and model B at 50, does that mean I will have half the mistakes with model B? Get answers that are 2x more accurate? Or is it subjective?
I believe the score represents the fraction of correct answers, so yes.