------
"I'm working with a new computer language. What would be the output of:
IsTrue is not true
If IsTrue is true then print IsTrue
If IsTrue is not true then print IsNotTrue"
------
It hemmed and hawed, and accurately describe what the program would do, which is basically just repeating back the last two lines to me. But refused to tell me what the output would be. When I demanded it tell me what the value of "IsTrue" would be, so I could figure out the output, I got:
"I apologize for the confusion, but as an AI language model, I don't have access to the specific values of variables in your code or the ability to execute code directly. In the given context, the value of IsTrue is not specified, so I cannot determine its exact value. It could be either true or a value that is not true, depending on how the variable is defined or assigned in your code."
I then gave it the exact same program in C#, and it unsurprisingly gave me not only a far more meaningful description of what the code does, but also the exact output - immediately.
Because OpenAI says there isn't, and there are open source LLMs which show the same (but less profound) ability.
> expert system effectively akin to an interpreter working behind the scenes?
You're describing reasoning again. No-one hardcoded an "expert system" for Python into ChatGPT. If it has become one, it is through reading about Python (and same for C#).
Also, expert system [1] needs not be in quotes. It's an 'AI' technology dating back to the 60s. It's essentially just a fancy term for hard-coding queryable domain specific knowledge into a system. As an aside, where has OpenAI claimed any of this is false? Or, for that matter, which open source LLMs produce code that's not completely buggered?
*: (such as when GPT-4 describes what would be output by Python code that I write and feed it, if it was run, despite GPT-4 not having any access to a Python interpreter and therefore having to simulate what one would do with my code, and despite my code not being in its training set.)
> especially one gifted with the ability for infinite perfect and complete recall.
You know that LLMs don't have this, right? There is no database they have access to containing their training data. They just have the weights that were optimized in response to seeing that training data.