See https://academic.oup.com/mind/article/LIX/236/433/986238 for the original paper.
However, I do count responding well to softball questions as important markers of our progress. Ten years ago, no one was able to pass even this mark.
(And from a commercial point of view, good enough 'understanding' and responses might be good enough for many tasks.
For example, I am a native German speaker, but I found that Google Translate often already does a better job of translating English to German than I could do, unless I spent unreasonable amounts of time on the task.
At the moment the most efficient way for me to produce a translation is to let Google Translate do the work, and then proof-read to spot cases were the machine didn't have enough context to resolve an ambiguity the right way.)
(Basically just write a prompt like "translate the following to German/Chinese/Whatever:")
The issue with general AI is like issue with chess. People are not happy when robot can win some games. People can only accept that robot really plays chess, when robot defeated best of the best.
General AI is the same. Looking like some guy is not enough. You need to reason better than smartest human on the planet, only then people will admit that general AI is there. That's a high bar.
You can definitely talk someone to agree that he's not conscious using some logic tricks. Not everyone, for sure, but someone who may be doesn't really care that much about that concept.
You also can tune AI so it'll not agree that he's unconscious no matter what.
What I'm trying to deliver is that there's no easy border which can divide conscious from unconscious. The only border was Turing test and robots passed it. Now you can test whether that particular robot talks like a very smart person, etc. But you can't distinguish bot from some random not-so-smart person.
For myself I'm satisfied that, when questioned thoroughly, these models fail so completely and utterly and their output is so ludicrously nonsensical that I don't see how their behaviour can be consistent with consciousness, as I understand it. It's not just that the output is incoherent, but it's the ways that they fail too. Do I completely understand consciousness? No, but that doesn't mean these things are conscious either.
Careful about how you word this.
Only a conscious being can agree that is not conscious.
I think you mean you can get the program to output text that proclaims its lack of consciousness.