Does GPT-4 Pass the Turing Test?

Re:Does GPT-4 Pass the Turing Test? by skybrian on Sunday November 26, 2023 @02:58PM (#38424449)

> We adopt a two-player implementation of the Turing Test, where an interrogator asks questions of a single witness and must decide if they are human or an AI. This differs from Turing’s original three-person formulation, but obviates the need to have multiple human participants online for each game.

So, not actually a Turing test. A real Turing test is much harder, because the humans (if they've practiced) can try to coordinate, sort of like playing Werewolf.

See my blog post: https://skybrian.substack.com/p/done-right-a-turing-test-is-...

[ Parent | on HN ]

Re:Does GPT-4 Pass the Turing Test? by camrobjones on Tuesday December 05, 2023 @01:19AM (#38527686)

Thanks for pointing this out, we do discuss it briefly in section 4.2, but I like your analysis in the blog!

Since the models are not passing, we didn't think it was a huge issue. If models are consistently passing the 2-person version, I think the motivation for running a (more cumbersome) 3-person version would be a lot stronger.

[ Parent | on HN ]