Re:I Taught ChatGPT to Invent a Language
by shagie on Tuesday December 06, 2022 @06:32PM
(#33888615)
Some time back I recall a PBS program (Nova? - though I think it was Alan Alda which would have made it Scientific American Frontiers) that had a Turing test of sorts in it.
The structure of that test (this was a while back - couldn't do an unconstrained one) had a panel composed of some chat bots and some humans (10 total, though the number isn't too important). Each was limited to the area of their specialty - I think there was a chatbot that had its specialty of bartending drinks.
The people evaluating them rated them on a distinct 1-10(?) scale. The question was trying to find a "what is the most human like chat bot."
Part of it was that the human expert in Shakespeare was considered to be more computer like than many of the chatbots in part because of the depth of knowledge in that domain.
The structure of that test (this was a while back - couldn't do an unconstrained one) had a panel composed of some chat bots and some humans (10 total, though the number isn't too important). Each was limited to the area of their specialty - I think there was a chatbot that had its specialty of bartending drinks.
The people evaluating them rated them on a distinct 1-10(?) scale. The question was trying to find a "what is the most human like chat bot."
Part of it was that the human expert in Shakespeare was considered to be more computer like than many of the chatbots in part because of the depth of knowledge in that domain.