Of course they can't just talk to themselves and improve the knowledge of the world. They are just stochastics parrots that give you an average answer.

LLMs giving you something novel would be like if you let a model play chess against itself and become the best player in the world this way. Totally impossible.

/sacrasm