It won't iterate on its own, but you can do it. You can ask it for a list of things to try, and they will be different alternatives. You can also tell it the result of an experiment and it will often figure out what to fix.

If you follow the link I shared, some researchers automated asking GPT4 to write tests, running the tests in a sandbox, and feeding the results back in.