News for hackers. Stuff that matters.
Re:GPT-4.1 in the API by ezyang on Monday April 14, 2025 @07:38PM (#43687462)
Lmarena isn't that useful anymore lol
Re:GPT-4.1 in the API by int_19h on Monday April 14, 2025 @10:32PM (#43688484)
I actually agree with that, but it's generally better than other scores. Also, the quote is like a year old at this point.

In practice you have to evaluate the models yourself for any non-trivial task.