Re:Statement on US government directive to suspend access to...
by greenavocado on Friday June 12, 2026 @09:37PM
(#48511509)
You're not wrong, but the scores track with my experience switching between the proposed top variants. So there's my unscientific "evidence."
False positives and poorly defined tasks/acceptance criteria have let some models have insanely inflated scores on bad benchmarks.
And sure, you can say they're not disclosed to prevent gaming, but if you're the only one who can review them then the might as well be a random number generator display with an unreadable UI.