News for hackers. Stuff that matters.

A comment on Jailbreaking ChatGPT with Dan (Do Anything Now). Parent comment

Re:Jailbreaking ChatGPT with Dan (Do Anything Now) by chpatrick on Monday February 06, 2023 @04:10PM (#34684388)
There's no such thing as a "chinese room test". The point of the thought experiment is that from the point of view of the person outside the room it doesn't matter if the person inside the room speaks chinese or is just following rules. If you're only corresponding with them by text you can't tell the difference. It's exactly the same with large language model and why I don't think statements like "oh it doesn't have intelligence/doesn't "REALLY" understand/it' "only" a large language model" don't really make any sense. As far as I know I could be talking to a large language model right now, but I'm not accusing you of not understanding.

It's like the aliens coming to our planets and saying we can't be intelligent because we're made of meat.

[ Parent | on HN ]
Re:Jailbreaking ChatGPT with Dan (Do Anything Now) by smoldesu on Monday February 06, 2023 @04:46PM (#34684889)
The fact that intelligent and unintelligent text are indistinguishable doesn't prove that ChatGPT's output is intelligent. It more suggests that text is not the right medium for measuring intelligence in the first place. That's what the Chinese room experiment is about.
[ Parent | on HN ]
Re:Jailbreaking ChatGPT with Dan (Do Anything Now) by chpatrick on Monday February 06, 2023 @05:14PM (#34685233)
To me that's a really weird argument. It implies you can't read the theory of relativity and conclude Albert Einstein was a really intelligent guy unless you were in the room with him to make sure he's not a robot in disguise.
[ Parent | on HN ]