News for hackers. Stuff that matters.
Re:GPT-4o by p1esk on Tuesday May 14, 2024 @12:13AM (#40351549)
This is still gpt4. I don’t expect much more from this version than what previous version could do, in terms of reasoning abilities.

But everyone is expecting them to release gpt5 later this year, and it is a bit scary to think what will it be able to do.

Re:GPT-4o by jiggawatts on Tuesday May 14, 2024 @01:22AM (#40351878)
Branding aside, this pretty much is GPT 5.

The evidence for that is the change in the tokenizer. The only way to implement that is to re-train the entire base model from scratch. This implies that GPT 4o is not a fine-tuning of GPT 4. It's a new model, with a new tokenizer, new input and output token types, etc...

They could have called it GPT-5 and everyone would have believed them.

Re:GPT-4o by p1esk on Tuesday May 14, 2024 @01:59AM (#40352069)
I’ve used it for a couple of hours to help with coding and it feels very similar to gpt4: still makes erroneous and inconsistent suggestions. Not calling it 4.5 was the right call. It is much faster though.

The expectations for gpt5 are sky high. I think we will see a similar jump as 3.5 -> 4.

Re:GPT-4o by adroniser on Tuesday May 14, 2024 @02:43AM (#40352300)
That doesn't imply that it's GPT-5. A GPT-4 training run probably doesn't take them that long now they've acquired so many GPUs for training GPT-5.
Re:GPT-4o by mewpmewp2 on Tuesday May 14, 2024 @06:08AM (#40353483)
Pretty sure they said they would not release GPT-5 on Monday. So it's something else still. And I don't see any sort of jump big enough to label it as 5.

I assume GPT-5 has to be a heavier, more expensive and slower model initially.

GPT-4o is like an optimisation of GPT-4.

Re:GPT-4o by golol on Tuesday May 14, 2024 @01:23AM (#40351889)
I think 4o is actually noticeably smarter than 4, after having tried it a tiny bit on the playground.
Re:GPT-4o by jimmySixDOF on Tuesday May 14, 2024 @05:07AM (#40353107)
There has been speculation that this is the same mystery model floating around on lmsys chat bot arena and they claim a real observable jump on elo scores but this remains to be seen some people don't think its even as capable as GPT4-Turbo so tbd
Re:GPT-4o by trashtester on Tuesday May 14, 2024 @05:58AM (#40353415)
It's quite different from gpt4 in two respects:

1) It's natively multi-modal in a way I don't think gpt4 was.

2) It's at least twice as efficient in terms of compute. Maybe 3 times more efficient, considering the increase in performance.

Combined, those point towards some major breakthroughs having gone into the model. If the quality of the output hasn't gone up THAT much, it's probably because the technological innovations mostly were leveraged (for this version) to reduce costs rather than capabilities.

My guess is that we should expect them to leverage the 2x-3x boost in efficiency in a model that is at least as large as GTP4 relatively soon, probably this year unless OpenAI has safety concerns or something, and keeps it internal-only.

Re:GPT-4o by hackerlight on Tuesday May 14, 2024 @08:06AM (#40354286)
It's a completely new model trained from scratch that they've decided to label that way as part of their marketing strategy.