News for hackers. Stuff that matters.
Re:A New Chat Bot Is a ‘Code Red’ for Google’s Search Business by morsecodist on Friday December 23, 2022 @10:30PM (#34113643)
What kinds of things do you query? I am genuinely curious. I have seen people say things like this about ChatGPT and it makes me wonder if we are using the same product. I have developed a hobby application with GPT-3 completion and I have ChatGPT more or less daily a week or so mostly for programing related queries. I have found the error rate to be extremely high, like > 20%. Not just sub-optimal but producing code that does not work, in python, which is a very common language. It is really tempting to use it for things like regexes or time format strings (the latter it does do well IMO) because often you want something too specific to google. When it works it's great but my trust in it has been shaken and I don't see myself using it long term.
Re:A New Chat Bot Is a ‘Code Red’ for Google’s Search Business by scarface74 on Saturday December 24, 2022 @12:26AM (#34114257)
I had a JSON file with the following format:

[{“Key”:”Company”},{“Value”:”${company}”},…]

I asked it to write a Python script that replaces any word surrounded by ${} with the value in its corresponding environment variable and accept the path of the file as a command line argument —json-file using argparse. It worked perfectly.

Then I started asking it to write a script to successively do the following

Given the same json file, write a snippet of YML that looks like sample CF templates parameter section that I gave it.

https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGui...

It worked perfectly.

Then I told it to accept an optional argument that generated the corresponding meta data section. It worked flawlessly. I gave it sample expected output

https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGui...

Then I told it to output the format needed to pass those parameters to a nested stack and gave it an example;

Parameters: Company: !Ref company

…

It worked again.

Finally, I needed it to generate the Python code to generate the CodeBuild Environment section and I gave it an example.

https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGui...