News for hackers. Stuff that matters.
Re:GPT-4.5 or GPT-5 being tested on LMSYS? by JacobiX on Monday April 29, 2024 @01:43PM (#40201529)
The model provides verbose answers even when I asked for more succinct ones. It still struggles with arithmetic (for example, it incorrectly stated "7739 % 23 = 339 exactly, making 23 a divisor"). When tested with questions in French, the responses were very similar to those of GPT-4. It is far better in knowledge based questions, I've asked this difficult one (it is not 100% correct but better than other LLMs) :

In Anna Karenina what does it mean: most of us prefer the company of Claras ?

Re:GPT-4.5 or GPT-5 being tested on LMSYS? by electrondood on Tuesday April 30, 2024 @12:31AM (#40207263)
Given the wide variety of experiences of commenters here, I'm starting to wonder if they're split testing multiple versions.