Does GPT-4 Pass the Turing Test?

Re:Does GPT-4 Pass the Turing Test? by thepablohansen on Sunday November 26, 2023 @03:12PM (#38424563)

Fascinating that the human benchmark is 63%- I wonder what the benchmark would look like were it to have been established, say, 30 years ago, before the prevalence of LLMs; I'd wager it would be very close to 100%. Speaks to the moving goalposts.

[ Parent | on HN ]

Re:Does GPT-4 Pass the Turing Test? by Veedrac on Sunday November 26, 2023 @04:26PM (#38425158)

This is almost surely just because it wasn't a real Turing Test. The paper discusses some limitations.

[ Parent | on HN ]

Re:Does GPT-4 Pass the Turing Test? by camrobjones on Tuesday December 05, 2023 @01:23AM (#38527710)

I think the key thing to remember with the human benchmark is that it will change depending on interrogators' assumptions about human abilities.

When models are bad, humans are easy to spot. But if the model's pretty good, it's harder to be sure you're talking to a human.

On top of that, I think a lot of human users didn't want to get got by the model, so they had an a priori bias toward saying AI.

[ Parent | on HN ]