News for hackers. Stuff that matters.
Re:GPT-4.1 in the API by poormathskills on Monday April 14, 2025 @01:31PM (#43683840)
Go look at their past blog posts. OpenAI only ever benchmarks against their own models.

This is pretty common across industries. The leader doesn’t compare themselves to the competition.

Re:GPT-4.1 in the API by oofbaroomf on Monday April 14, 2025 @01:54PM (#43684164)
Leader is debatable, especially given the actual comparisons...
Re:GPT-4.1 in the API by kweingar on Monday April 14, 2025 @03:09PM (#43684958)
That would make sense if OAI were the leader.
Re:GPT-4.1 in the API by dimitrios1 on Monday April 14, 2025 @01:36PM (#43683923)
There is no uniform tactic for this type of marketing. They will compare against whomever they need to to suit their marketing goals.
Re:GPT-4.1 in the API by swyx on Monday April 14, 2025 @02:49PM (#43684723)
also sometimes if you get it wrong you catch unnecessary flak
Re:GPT-4.1 in the API by christianqchung on Monday April 14, 2025 @04:22PM (#43685904)
Okay, it's common across other industries, but not this one. Here is Google, Facebook, and Anthropic comparing their frontier models to others[1][2][3].

[1] https://blog.google/technology/google-deepmind/gemini-model-...

[2] https://ai.meta.com/blog/llama-4-multimodal-intelligence/

[3] https://www.anthropic.com/claude/sonnet

Re:GPT-4.1 in the API by poormathskills on Monday April 14, 2025 @04:47PM (#43686138)
Right. Those labs aren’t leading the industry.
Re:GPT-4.1 in the API by comp_throw7 on Tuesday April 15, 2025 @01:31AM (#43689255)
Confusing take - Gemini 2.5 is probably the best general purpose coding model right now, and before that it was Sonnet 3.5. (Maybe 3.7 if you can get it to be less reward-hacky.) OpenAI hasn't had the best coding model for... coming up on a year, now? (o1-pro probably "outperformed" Sonnet 3.5 but you'd be waiting 10 minutes for a response, so.)
Re:GPT-4.1 in the API by awestroke on Monday April 14, 2025 @04:44PM (#43686112)
Except they are far from the lead in model performance
Re:GPT-4.1 in the API by poormathskills on Monday April 14, 2025 @04:49PM (#43686168)
Who has a (publicly released) model that is SOTA is constantly changing. It’s more interesting to see who is driving the innovation in the field, and right now that is pretty clearly OpenAI (GPT-3, first multi-modal model, first reasoning model, ect).