News for hackers. Stuff that matters.
Re:Learning to Reason with LLMs by carabiner on Thursday September 12, 2024 @02:51PM (#41524221)
can you ask it:

9.11 and 9.9, which number is larger

Re:Learning to Reason with LLMs by hidelooktropic on Thursday September 12, 2024 @03:19PM (#41524486)
> Evaluating Number formats > I'm considering that the question might be about comparing two numbers, 9.11 and 9.9, in different contexts such as different locale formats or representing dates. 9.11 is larger than 9.9

Well, it's kind of right because we left it ambiguous what kinds of numbers these are. September 11 is a greater date than September 9. However, I would want the model to have the street smarts to assume without further context, I must be just talking about numbers as in numbers.

Re:Learning to Reason with LLMs by oytis on Thursday September 12, 2024 @03:41PM (#41524687)
Was it trained on Excel code?
Re:Learning to Reason with LLMs by peppertree on Thursday September 12, 2024 @03:10PM (#41524413)
4.9 is larger than 4.11.

Explanation:

• 4.9 is equivalent to 4.90. • 4.11 remains 4.11.

When comparing the numbers:

• 4.90 (which is 4.9) • 4.11

Since 4.90 > 4.11, 4.9 is the larger number.

Re:Learning to Reason with LLMs by carabiner on Thursday September 12, 2024 @03:54PM (#41524813)
Try it with 9.11 and 9.9. Some have proposed that it thinks "9.11" is larger because in a social context 9/11 has much larger significance.
Re:Learning to Reason with LLMs by glial on Thursday September 12, 2024 @08:27PM (#41527038)
From o1-mini:

To determine which number is larger between 9.11 and 9.9, let's compare them step by step:

Understanding the Numbers: 9.11 can be read as "nine and eleven hundredths." 9.9 can be read as "nine and nine tenths." To make the comparison easier, you can also think of it as 9.90 (adding a zero doesn't change the value).

Comparing the Decimal Places: Ones Place: Both numbers have 9 in the ones place. Tenths Place: 9.11 has a 1 in the tenths place. 9.90 has a 9 in the tenths place.

Conclusion: Since 9.90 has a larger value in the tenths place compared to 9.11, 9.90 (or 9.9) is larger than 9.11. Therefore, 9.9 is larger than 9.11.

Re:Learning to Reason with LLMs by octernion on Thursday September 12, 2024 @03:12PM (#41524431)
it claims 9.11 is larger, hah.

https://postimg.cc/KKKLZNjW

Re:Learning to Reason with LLMs by peppertree on Thursday September 12, 2024 @03:44PM (#41524716)
That's odd. Tried several times with the same prompt and always got the correct answer with step by step explanation.
Re:Learning to Reason with LLMs by KeplerBoy on Thursday September 12, 2024 @04:18PM (#41525070)
Those models are just not deterministic.