News for hackers. Stuff that matters.
Re:OpenAI O3-Mini by kettleballroll on Friday January 31, 2025 @06:18PM (#42893570)
Typically in these tests you have three options "A is better", "B is better" or "they're equal/can't decide". So if 56% prefer O3 Mini, it's likely that way less than half prefer O1.also, the way I understand it, they're comparing a mini model with a large one.
Re:OpenAI O3-Mini by directevolve on Friday January 31, 2025 @06:22PM (#42893621)
If you use ChatGPT, it sometimes gives you two versions of its response, and you have to choose one or the other if you want to continue prompting. Sure, not picking a response might be a third category. But if that's how they were approaching the analysis, they could have put out a more favorable-looking stat.
Re:OpenAI O3-Mini by ignoramous on Friday January 31, 2025 @06:34PM (#42893756)
> If you use ChatGPT, it sometimes gives you two versions

Does no one else hate it when this happens (especially when on a handheld device)?