Show HN: O3 beats Sonnet 4 at coding (in our codebase, wrt our preferences)
At this point, the leading foundation models from each of the top labs tend to do well on the classic set of coding evals. Each new release brings smaller improvements over the last, with leading models separated by increasingly thin margins. This may be a sign we're heading toward commoditization.However, in our experience, these models can differ meaningfully when the task is narrow and the...