Re:OpenAI O3-Mini
by cm2187 on Friday January 31, 2025 @05:06PM
(#42892780)
And another way to rephrase it is that almost half of the users prefer the older model, which is terrible PR.
[ Parent
| on HN ]
Re:OpenAI O3-Mini
by tgsovlerkhgsel on Friday January 31, 2025 @05:50PM
(#42893281)
Not if the goal is to claim that the models deliver comparable quality, but with the new one excelling at something else (here: inferrence cost).
its mini to mini, its the same cost
Re:OpenAI O3-Mini
by kettleballroll on Friday January 31, 2025 @06:18PM
(#42893570)
Typically in these tests you have three options "A is better", "B is better" or "they're equal/can't decide". So if 56% prefer O3 Mini, it's likely that way less than half prefer O1.also, the way I understand it, they're comparing a mini model with a large one.
Re:OpenAI O3-Mini
by directevolve on Friday January 31, 2025 @06:22PM
(#42893621)
If you use ChatGPT, it sometimes gives you two versions of its response, and you have to choose one or the other if you want to continue prompting. Sure, not picking a response might be a third category. But if that's how they were approaching the analysis, they could have put out a more favorable-looking stat.
Re:OpenAI O3-Mini
by ignoramous on Friday January 31, 2025 @06:34PM
(#42893756)
> If you use ChatGPT, it sometimes gives you two versions
Does no one else hate it when this happens (especially when on a handheld device)?