> So it cannot produce novel insights which would be a requirement if LLMs should "solve science".

How sure are we about this statement, and why? I have been hearing this a lot, and it might be true, but I would like to read some research into this area.