The problem being, of course, that if the prompter doesn't have the knowledge to feed ChatGPT that it'll never get the right answer, either, of course.
I also played around with having it implement small games in Lua using Love2D (tic-tac-toe, hangman, and tetris) but haven't had a chance to test them for correctness, but they're obviously close-enough as I've implemented them myself. Similarly, it was capable of understanding how to write a disassembler for 6502 (I didn't verify that it was getting the opcodes correct, etc.), ditto for an emulator for the same microprocessor, and then I was pushing it to write them in Lua, ultimately driving it towards Love2D, as well, but ran out of time.
It's not perfect but it's really intriguing. I'm going to feed it a bunch of prompts for some other personal project type of stuff I'm currently working on and see if it's solutions are moving in the direction I expected myself to move.
> Write "hello world" in hnarguer
Here is how you can write "Hello, world!" in the hnarguer programming language:
(it can also do FizzBuzz)