News for hackers. Stuff that matters.

A comment on OpenAI O3-Mini. Parent comment

Re:OpenAI O3-Mini by scrollop on Saturday February 01, 2025 @03:30AM (#42896831)
Why can't you ask both questions (on a variety of topics etc), and grade the answers vs an ideal answer?

Ends before means.

If 4o answered better than o3, would you still use 03 for your task just because you were told it can "reason"?

[ Parent | on HN ]
Re:OpenAI O3-Mini by koakuma-chan on Saturday February 01, 2025 @07:52AM (#42897939)
The point is that you cannot make a general statement that “o1 is better than 4o.”
[ Parent | on HN ]
Re:OpenAI O3-Mini by freehorse on Saturday February 01, 2025 @08:17AM (#42898060)
Yes, but because you need to say exactly what one is better than the other for. Not because o1 spends a bunch of tokens for "reasoning" you cannot even see.
[ Parent | on HN ]
Re:OpenAI O3-Mini by koakuma-chan on Saturday February 01, 2025 @08:33AM (#42898161)
If you would like to see the CoT process visualized, try the “Improve prompt” feature in Anthropic console. Also check out https://github.com/getAsterisk/deepclaude
[ Parent | on HN ]