News for hackers. Stuff that matters.
Re:Large Enough – Mistral AI by Workaccount2 on Wednesday July 24, 2024 @11:56AM (#41058338)
I think GPT5 will be the signal of whether or not we have hit a plateau. The space is still rapidly developing, and while large model gains are getting harder to pick apart, there have been enormous gains in the capabilities of light weight models.
Re:Large Enough – Mistral AI by chipdart on Wednesday July 24, 2024 @12:08PM (#41058489)
> I think GPT5 will be the signal of whether or not we have hit a plateau.

I think GPT5 will tell if OpenAI hit a plateau.

Sam Altman has been quoted as claiming "GPT-3 had the intelligence of a toddler, GPT-4 was more similar to a smart high-schooler, and that the next generation will look to have PhD-level intelligence (in certain tasks)"

Notice the high degree of upselling based on vague claims of performance, and the fact that the jump from highschooler to PhD can very well be far less impressive than the jump from toddler to high schooler. In addition, notice the use of weasel words to frame expectations regarding "the next generation" to limit these gains to corner cases.

There's some degree of salesmanship in the way these models are presented, but even between the hyperboles you don't see claims of transformative changes.

Re:Large Enough – Mistral AI by rvnx on Wednesday July 24, 2024 @12:20PM (#41058640)
PhD level-of-task-execution sounds like the LLM will debate whether the task is ethical instead of actually doing it
Re:Large Enough – Mistral AI by throwadobe on Wednesday July 24, 2024 @02:08PM (#41059910)
I wish I could frame this comment
Re:Large Enough – Mistral AI by airspresso on Wednesday July 24, 2024 @12:42PM (#41058894)
lol! Producing academic papers for future training runs then.
Re:Large Enough – Mistral AI by splwjs on Wednesday July 24, 2024 @12:27PM (#41058726)
>some degree of salesmanship

buddy every few weeks one of these bozos is telling us their product is literally going to eclipse humanity and we should all start fearing the inevitable great collapse.

It's like how no one owns a car anymore because of ai driving and I don't have to tell you about the great bank disaster of 2019, when we all had to accept that fiat currency is over.

You've got to be a particular kind of unfortunate to believe it when sam altman says literally anything.

Re:Large Enough – Mistral AI by sensanaty on Wednesday July 24, 2024 @01:59PM (#41059812)
Basically every single word out of Mr Worldcoin's mouth is a scam of some sort.
Re:Large Enough – Mistral AI by zainhoda on Wednesday July 24, 2024 @12:05PM (#41058442)
I’m waiting for the same signal. There are essentially 2 vastly different states of the world depending on whether GPT-5 is an incremental change vs a step change compared to GPT-4.
Re:Large Enough – Mistral AI by mupuff1234 on Wednesday July 24, 2024 @01:10PM (#41059273)
Which is why they'll keep calling the next few models GPT4.X