You're focusing too close, abstract up a level. Your point relates to the "micro" system functioning, not the wider "macro" result (think emergent capabilities).
An apple falls to the ground because of? gravity.
In real life this is the answer, I'm very sure the pre-carved channel will also lead to gravity.
Most of the time that data is already available to it and they merely need to a prove a thereom using existing historic data points and math.
For instance the Black-Scholes-Merton equation which won the Nobel economics prize was derived using preexisting mathematical concepts and mathematical principles. The application and validation relied on existing data.
LLMs only rearrange descriptions of discoveries. They can't recognize when their model contradicts reality because they never touch reality. That's not a solvable limitation. It's definitional.
We're clearly operating from different premises about what constitutes discovery versus recombination. I've made my case; you're welcome to the last word
LLM's these days have reasoning and can learn in context. They do touch reality, your feedback. It's also proven mathematically. Other people's scientific papers are critiqued and corrected as new feedback arrives.
This is no different to claude code bash testing and fixing it's own output errors recursively until the code works.
They already deal with unknown combinations all day, our prompting.
Yes it is brittle though. They are also not very intelligent yet.
The same goes for humans. Most awards are built on novel research built on pre-existing works. This a LLM is capable of doing.