News for hackers. Stuff that matters.

A comment on OpenAI's plans according to sama. Parent comment

Re:OpenAI's plans according to sama by Imnimo on Wednesday May 31, 2023 @10:13PM (#36146874)
And, if I'm reading their calculation right, that's 85% on the medium-difficulty bucket, not even the entire HumanEval benchmark?

(quoting from the GPT-4 paper):

>All but the 15 hardest HumanEval problems were split into 6 difficulty buckets based on the performance of smaller models. The results on the 3rd easiest bucket are shown in Figure 2

[ Parent | on HN ]
Re:OpenAI's plans according to sama by PoignardAzur on Thursday June 01, 2023 @08:48AM (#36150371)
That does seem to support the idea that we're two or three major breakthroughs away from superintelligent AGI, assuming these scaling curves keep holding as they have.
[ Parent | on HN ]