News for hackers. Stuff that matters.
Re:DeepSeek-v3.1-Terminus by IgorPartola on Monday September 22, 2025 @11:31AM (#45334853)
Thanks! Are the scores in some way linear here? As in, if model A is rated at 25 and model B at 50, does that mean I will have half the mistakes with model B? Get answers that are 2x more accurate? Or is it subjective?
Re:DeepSeek-v3.1-Terminus by esafak on Monday September 22, 2025 @07:25PM (#45340887)
I believe the score represents the fraction of correct answers, so yes.