News for hackers. Stuff that matters.
Re:Nvidia and OpenAI abandon unfinished $100B deal in favour... by coder543 on Friday February 20, 2026 @09:32AM (#47088509)
No... benchmarks are not always "fishy." That is just a defense people use when they have nothing else to point to. I already said the benchmarks aren't perfect, but they are much better than claiming vibes are a more objective way to look at things. Yes, you should test for your individual use case, which is a benchmark.

As I said, I have been following this stuff closely for many years now. My opinion is not informed just by looking at a single chart, but by a lot of experience. The chart is less fishy than blanket statements about the closed models somehow being way better than the benchmarks show.

There are no comments on this comment yet.