It does spectacular job with well trodden paths. Asked it to give me a map react control with points plotted and got something working in a jiffy.

I was trying to get it write robot framework code earlier and it was remarkably terrible. I would point out an obvious problem, it would replace the code with something even more spectacularly wrong.

When I pointed out the new error, it just gave me the exact same old code.

This happened again and again.

It was almost entirely useless.

Really showed how the sausage is made, this generation of AI is just regurgitation of patterns it stole from other people.

In my experience 4o is really good at ignoring user-provided corrections and insanely regurgitating the same code (and/or the same problems) over and over again.

ChatGPT 4 does much better with corrections, as does Claude. 4o is a pox.

That 4o is often times worse that GPT 4 has been widely ignored. :/