Re:Gemma3 – The current strongest model that fits on a singl...
by amelius on Wednesday March 12, 2025 @07:12AM
(#43341993)
Aren't there any "blind" benchmarks?
[ Parent
| on HN ]
Re:Gemma3 – The current strongest model that fits on a singl...
by nathanasmith on Wednesday March 12, 2025 @09:39AM
(#43343150)
Unfortunately that wouldn't help as much as you think since talented AI labs can just watch the public leaderboard and note what models move up and down to deduce and target whatever the hidden benchmark is testing.
Re:Gemma3 – The current strongest model that fits on a singl...
by nickthegreek on Wednesday March 12, 2025 @11:46AM
(#43344464)
OpenRouter Arena Ratings are probably the closet thing.