> LLMs have completely failed to generate what I would consider to be acceptable code

Totally agree. Recently I asked ChatGPT to write a Z-80 assembler function to multiply two 8-bit numbers. I specified Z-80 assembler to get away from the mainstream. I tried the same prompt three times and got three different responses, two of which were obviously wrong and the third had no obvious flaw but was rather clumsy.