News for hackers. Stuff that matters.
Re:GPT-4 Can't Reason by layer8 on Tuesday August 08, 2023 @12:11PM (#37051295)
ChatGPT in general seems to have trouble with time-based reasoning. In several conversations I had, while it understood that dates are ordered and that events are ordered, and that events are associated with dates, it did not understand that the two orders have to be consistent with each other via that association. Given certain constraints on the order of the dates (or times of day), it was not able to apply that information to correctly infer constraints on the order (“before”/“after”) of the associated events.
Re:GPT-4 Can't Reason by cs702 on Tuesday August 08, 2023 @12:18PM (#37051390)
...And that's only one example of a reasoning test, out of 21 different types of reasoning tests.

The other tests have nothing to do with time.

Re:GPT-4 Can't Reason by layer8 on Tuesday August 08, 2023 @12:21PM (#37051442)
I was reporting my experience to give more detail to the argument. I agree with the paper.
Re:GPT-4 Can't Reason by cs702 on Tuesday August 08, 2023 @12:25PM (#37051521)
Ah, I see what you mean. Thank you for sharing and for clarifying!