Sounds solvable though once LLMs like ChatGPT become "live" (e.g connected to the internet) they can perhaps verify their answers. They will probably have their own development environment at some point. So these things might still happen in the future but rarely.