Re:Magistral — the first reasoning model by Mistral AI
by derefr on Wednesday June 11, 2025 @04:26PM
(#44251444)
I presume that "outdated upon release" benchmarks like these happen because the benchmark and the models in it were chosen first, before the model was created; and the model's development progress was measured using the benchmark. It then doesn't occur to anyone that the benchmark the engineers had been relying upon isn't also a good/useful benchmark for marketing upon release. From the inside view, it's just a benchmark, already there, already achieving impressive results, a whole-company internal target to hit for months — so why not publish it?
[ Parent
| on HN ]
There are no comments on this comment yet.