News for hackers. Stuff that matters.

A comment on Ask HN: Is GPT-4o overall worse than GPT-4 for you?. Parent comment

Re:Ask HN: Is GPT-4o overall worse than GPT-4 for you? by nullbio on Wednesday May 22, 2024 @04:58AM (#40438878)
Take those results with a large grain of salt. It's dead simple to figure out which response is the new model purely by the speed at which the result is returned, and as such, this is incredibly easy to bot in an effort to manipulate the rankings.

They should really be streaming the content at the same time, based on the slowest responder.

[ Parent | on HN ]
Re:Ask HN: Is GPT-4o overall worse than GPT-4 for you? by speedgoose on Wednesday May 22, 2024 @07:28AM (#40439696)
Who would manipulate the rankings to make OpenAI look better? Are you sure you can tell the difference between a small llama3 8b or a fast gemini?
[ Parent | on HN ]