I spend most of my academic years studying type systems. Unless you work on space crafts or blockchain tech, that level of security is not needed. Modern typesystems is about DX rather than assuring correctness.
It is easy to be pessimistic on new technology. Sometimes it is merited. Oftentimes it is noise and needless rant.
They get almost exactly what they had in mind every single time.
I use ChatGPT and Copilot for software development daily and it's not giving me any functions that don't exist. Tune your custom instructions. And yes, sure - it shouldn't be used by junior devs in the current state. But it accelerates the seniors so much it's unbelievable.
GPT-4 is fantastic at taking a detailed requirement/question from an expert user and giving a good answer. Curiously, it sometimes doesn't respond well if it perceives one as a non-expert user - it'll start lecturing on BS, or avoid giving an answer.
A Q&A engine who's every answer should be reviewed by an expert or else?
A code generator that might generate code that has serious logical bugs or making calls to functions and libraries that don't exist or even might have syntax errors so to be useful, you have to have the above or average knowledge of that language to correct the output?