>However at some point you have to admit the LLM does generate things that are good answers.

Hawing a noise generator sometimes generate something that looks like a valid signal doesn’t mean it’s not a noise generator.