News for hackers. Stuff that matters.

A comment on Sam Altman's ouster was precipitated by letter to board about AI breakthrough. Parent comment

Re:Sam Altman's ouster was precipitated by letter to board a... by xanderlewis on Wednesday November 22, 2023 @06:55PM (#38386993)
That ‘that’s what humans do too’ is also a repetitive statement. The truth lies somewhere in between, as always: humans and LLMs are similar, but in their current state LLMs do have a serious problem with reasoning tasks — even ones children find trivial.
[ Parent | on HN ]
Re:Sam Altman's ouster was precipitated by letter to board a... by WhitneyLand on Wednesday November 22, 2023 @07:31PM (#38387472)
What reasoning problem do children find trivial and LLM’s have serious problems with?

I can’t think of any off the top of my head.

I also tried to get GPT4 to craft such a problem and it was unable to: https://chat.openai.com/share/c1d5af4b-1d45-41ed-8f5a-746ea0...

[ Parent | on HN ]
Re:Sam Altman's ouster was precipitated by letter to board a... by RationalDino on Wednesday November 22, 2023 @08:07PM (#38387810)
Solving mazes. GTP4 got stuck at 7x7.

https://ekzhu.medium.com/gpt-4s-maze-navigation-a-deep-dive-...

[ Parent | on HN ]
Re:Sam Altman's ouster was precipitated by letter to board a... by TeMPOraL on Wednesday November 22, 2023 @09:04PM (#38388293)
My 4.5 yo wouldn't solve a 7x7 maze zero-shot either, not off-hand. Not even given multiple examples. Especially if getting confused, frustrated, and giving up is a valid move.

At which point and after how much training a kid becomes able to solve mazes like this? Also, given how one can pull a problem like this - any problem - out of their ass, describe it to GPT-4, and it has a good chance of solving it, that's quite amazing compared to children generally not being capable of this.

[ Parent | on HN ]