News for hackers. Stuff that matters.
Re:GPT4 Can’t Ace MIT by civilitty on Saturday June 17, 2023 @11:35PM (#36377072)
I’ve seen the recent statement by someone at OpenAI but whatever weasel words they use, it did change.

The modified cabbage-goat-lion problem [1] that GPT4 always failed to solve, it now gets it right. I’ve seen enough people run it in enough variations [2] before to know that it absolutely did change.

Maybe they didn’t “change” as in train anything, but it’s definitely been RHLFed and it’s impacting the results.

[1] https://news.ycombinator.com/item?id=35155467

[2] dozens of people, hundreds of times total

There are no comments on this comment yet.