Re:ChatGPT Caused 'Code Red' at Google, Report Says
by scarface74 on Saturday December 24, 2022 @09:29AM
(#34117084)
I’ll give you that,
I once asked it write a Python script that lists all of the accounts in an AWS organization with a given tag key and value.
It confidently, initiated the SDK (boto3) and the correct object on the SDK (Organizations) and then it called a none existent function - “get_accounts_by_tag”.
The next day I asked it the same question and it got it right using a technique that I would have never thought of.
On the other hand, I asked it “given the following XML file and a DynamoDB table with the following fields, write a Python script that replaces the value node in the file where a corresponding key is found in the table with the value in the value field”.
The code was perfect.
OTOH I've also asked it what day of the week a given date was and received two different wrong answers depending on the exact phrasing of the question. I've also seen it confidently "explain" why taking 90% of a number and adding 10% of that back will get you to the original number...
The trouble is the output is a mix of truth and lies, and GPT has no way to distinguish between the two.