Marriage over, €100k down; AI users whose lives were wrecked by delusion

Re:Marriage over, €100k down; AI users whose lives were wrec... by wat10000 on Thursday March 26, 2026 @02:01PM (#47533679)

In one study, GPT-4.5 was judged to be human 73% of the time, which means that the actual human was judged to be human only 27% of the time. More human than human, as Tyrell would say.

Edit: folks, the standard Turing test involves a computer and a human, and then a judge communicating with both and giving a verdict about which one is the human. The percentages for the two entities being judged will add up to exactly 100%. That's how this test was conducted. Please don't assume I'm a moron.

[ Parent | on HN ]

Re:Marriage over, €100k down; AI users whose lives were wrec... by dwpdwpdwpdwpdwp on Thursday March 26, 2026 @02:29PM (#47533992)

The implication would be that GPT-4.5 was not judged to be human 27% of the time. You can't determine how often humans were judged correctly as humans from that data point.

[ Parent | on HN ]

Re:Marriage over, €100k down; AI users whose lives were wrec... by jmalicki on Thursday March 26, 2026 @02:54PM (#47534239)

The structure of the test was that there was one human and one AI conversation partner, and the rater had to choose which one was which.

Given that structure, you can judge from that data point.

[ Parent | on HN ]

Re:Marriage over, €100k down; AI users whose lives were wrec... by jmalicki on Thursday March 26, 2026 @03:30PM (#47534631)

That was also before the crazy AI hysteria we have today with the em-dash police everywhere.

[ Parent | on HN ]

Re:Marriage over, €100k down; AI users whose lives were wrec... by wat10000 on Thursday March 26, 2026 @06:09PM (#47536465)

For the test to be free of bias, we’ll have to ensure all the humans are from Nigeria.

[ Parent | on HN ]

Re:Marriage over, €100k down; AI users whose lives were wrec... by Melatonic on Thursday March 26, 2026 @02:36PM (#47534070)

Those stats dont necessarily line up that way. Do you have a link?

[ Parent | on HN ]

Re:Marriage over, €100k down; AI users whose lives were wrec... by jmalicki on Thursday March 26, 2026 @02:54PM (#47534250)

Given the way the test was structured it does line up.

https://arxiv.org/abs/2503.23674

[ Parent | on HN ]

Re:Marriage over, €100k down; AI users whose lives were wrec... by Melatonic on Thursday March 26, 2026 @03:37PM (#47534704)

Surprisingly good. I wonder how they would have done without the 5 minute limit on conversations (average of 8 messages per convo per the study)

[ Parent | on HN ]