LLMs can definitely end up with code that has never been written before, even before considering that you would be able both to ask it for modifications to very constrained parts of the code and can sample more broadly than always picking the most probably tokens.

But it also appear to have a far higher probability of producing changes that move towards something that will run.