> The big problem is that a person making a mistake can be taught to not make that mistake again. That's also not foolproof but at least it works a lot of the times.

You can do the same to an LLM with the same outcome.