> Do you see?
Emergence can only be discontinuous.
Emergent abilities can be gradual and continuous.
If it's continious then nothing is emerging and it can be explained by the sum of it's sub-systems.
Emergence can only be discontinuous.
You are using their study to claim that LLMs can not learn and reason about novel tasks. Their study doesn't make any claims about what LLMs can and can't do. The study says that when it appears that LLMs suddenly became able to reason about novel tasks, what actually happened is that the ability of the LLM to perform reasoning improved gradually and smoothly during its training until it could do those things. They are not saying that LLMs don't have emergent capabilities: they are saying that those capabilities emerged at a continuous rate rather than a discontinuous one.
Do you see?