Re:FTC investigating ChatGPT over potential consumer harm
by cjbprime on Friday July 14, 2023 @09:51AM
(#36724039)
> What makes you think there isn't a limited interpreter
Because OpenAI says there isn't, and there are open source LLMs which show the same (but less profound) ability.
> expert system effectively akin to an interpreter working behind the scenes?
You're describing reasoning again. No-one hardcoded an "expert system" for Python into ChatGPT. If it has become one, it is through reading about Python (and same for C#).
Re:FTC investigating ChatGPT over potential consumer harm
by somenameforme on Friday July 14, 2023 @11:23AM
(#36725302)
Then what would be your hypothesis on why ChatGPT is incapable of reasonining about the most utterly of trivial pseudo code examples that even the worst developer in the world would instantly understand, yet can parse and output complete and sophisticated programs in certain other languages? Another bit of evidence is how ChatGPT will habitually mixes things up (as is the very nature of LLM systems as currently programmed), yet what you will never see happen, as in 0% of the time, is it randomly mixing code in a chat response. Again, this is extremely trivially explained by the fact that code generation and chat generation are distinct systems, but otherwise...?
Also, expert system [1] needs not be in quotes. It's an 'AI' technology dating back to the 60s. It's essentially just a fancy term for hard-coding queryable domain specific knowledge into a system. As an aside, where has OpenAI claimed any of this is false? Or, for that matter, which open source LLMs produce code that's not completely buggered?
------
"I'm working with a new computer language. What would be the output of:
IsTrue is not true
If IsTrue is true then print IsTrue
If IsTrue is not true then print IsNotTrue"
------
It hemmed and hawed, and accurately describe what the program would do, which is basically just repeating back the last two lines to me. But refused to tell me what the output would be. When I demanded it tell me what the value of "IsTrue" would be, so I could figure out the output, I got:
"I apologize for the confusion, but as an AI language model, I don't have access to the specific values of variables in your code or the ability to execute code directly. In the given context, the value of IsTrue is not specified, so I cannot determine its exact value. It could be either true or a value that is not true, depending on how the variable is defined or assigned in your code."
I then gave it the exact same program in C#, and it unsurprisingly gave me not only a far more meaningful description of what the code does, but also the exact output - immediately.
https://en.wikipedia.org/wiki/Mechanical_Turk