The question that no LLM can answer and why it is important

Re:The question that no LLM can answer and why it is important by m463 on Wednesday April 24, 2024 @02:59AM (#40141473)

The one I liked someone wrote in a comment here a few days ago:

  I have 4 oranges, 1 apple and 2 pairs of shoes.
  I eat one apple and one shoe.
  How many fruits do I have?

[ Parent | on HN ]

Re:The question that no LLM can answer and why it is important by layer8 on Wednesday April 24, 2024 @12:50PM (#40146788)

You don’t even need the fruits to trip it up:

> I have two pairs of sandals and eat one sandal. How many sandals do I have left?

> If you started with two pairs of sandals and ate one sandal, you'd have one pair of sandals left, which is two sandals.

The fact that at the same time it explains that one pair is two sandals demonstrates the lack of awareness and proper reasoning.

[ Parent | on HN ]

Re:The question that no LLM can answer and why it is important by eigenvekt on Thursday April 25, 2024 @06:24AM (#40155652)

I don't know what tools people are using but I wouldn't have expected chatGPT4 to not get this. Of course it has no issue:

"After eating one apple from your original count of 4 oranges and 1 apple, you are left with 4 oranges. So, you have 4 fruits remaining."

The problem is people are using these shittier models and then pretending as if that is all models.

[ Parent | on HN ]

Re:The question that no LLM can answer and why it is important by m463 on Saturday April 27, 2024 @03:06AM (#40177926)

I think you left out the footwear...

[ Parent | on HN ]