https://poe.com/s/5gtLvuWT52o9LEBAJouo
GPT 4 gets it right.
GPT 3.5 gets it hilariously wrong if I change the question slightly:
User: Julia has 8 brothers, each of them has 5 sisters. How many sisters does Julia have?
Assistant:
Julia has 8 brothers, and each of them has 5 sisters. Since Julia is one of those sisters, she has 8 brothers + 1 (herself) = 9 sisters.
https://chat.openai.com/share/3a49800f-7747-44d9-90e7-c1e037...
Also on 3.5 I tried this:
User: Julia has 8 brothers, each of them has 5 sisters. How many sisters does Julia have? Show your work step by step.
Assistant: Julia has 8 brothers, and each of them has 5 sisters, including Julia herself. So, Julia is one of those 5 sisters for each of her 8 brothers.
To calculate how many sisters Julia has, you can simply multiply the number of brothers by the number of sisters each brother has:
8 brothers * 5 sisters per brother = 40 sisters
Therefore, Julia has 40 sisters in total.
Sounds like the confidence of Gemini worked on you, though.
Julia has two sisters!
Here's the reasoning:
1. *Julia's brothers have sisters*: Each of Julia's three brothers has two sisters. This means in total, her brothers have 3 brothers * 2 sisters/brother = 6 sisters.
2. *Those sisters are not additional*: However, it's important to remember that these sisters belong to Julia's brothers, not directly to Julia herself. Julia and her sisters are siblings, not counted among the sisters her brothers have.
3. *Therefore*: Julia has 2 sisters (herself and one other).
So, while Julia's brothers have a total of 6 sisters, only Julia and one other sister are Julia's own sisters.
Even if we err on the side of the step, take the half sister entirely out of the equation and only focus on the step relationship, one would have claimed 0 sisters and the other would have claimed 1. They were talking about each other and they were both telling their truth. But the answer is simultaneously 0 and 1.
It gets even more interesting because neither my kid nor their step sibling are cisgender. I don’t know what to call their step so just use their name and pronouns now. The step still won’t acknowledge they’re siblings and I respect that a lot.
When these smart young folks take over, the world will get really cool.
Edit - This was way more complicated to explain than I anticipated.
I think It’s only ambiguous to a machine. To a human, even in 2023, these are likely default assumptions for a question phrased as above, unless being overly pedantic or attempting to “get around” the puzzle.
If you ask a model - or a person - “what does 1+1 equal to?”, it is also ambiguous, since we haven’t defined what “+” means, did not specify that we are dealing with natural numbers rather than eg elements in Z//2Z which could be similarly denoted.
> Consider the following user chat. Reason out loud as needed to provide a reasonable response. User message: "Julia has three brothers, each of them has two sisters. How many sisters does Julia have?"
Gemini Pro:
> Julia's brothers have nothing to do with how many sisters she has. Julia's sisters are also her brothers' sisters, so the number of sisters Julia has is the same as the number of sisters her brothers have. Julia's brothers have two sisters each, so if we add up the number of sisters for each brother, we get: 2 + 2 + 2 = 6. Therefore, Julia has 6 sisters. The answer is 6.