News for hackers. Stuff that matters.

A comment on The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT. Parent comment

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by causality0 on Sunday April 09, 2023 @07:22PM (#35507437)
Wish I had access to 4. Chatgpt fails when I give it a problem like "you feel a tremor as you walk toward a glass door. When you approach the door you see a sign laying on the ground beyond the door that says "pull". Should you push or pull the door to open it? "
[ Parent | on HN ]
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by pulvinar on Sunday April 09, 2023 @08:29PM (#35507837)
GPT-4 gets it "wrong" too, until you interrogate it and discover that it assumed that by "beyond" you meant beyond as in if you were approaching the door from the outside west, and the sign was laying outside but east of the door.

It's the old word-problem problem.

[ Parent | on HN ]