News for hackers. Stuff that matters.
Re:AI knows things no one told it by cjbprime on Friday May 12, 2023 @07:01PM (#35923612)
This is a misunderstanding of the researchers' claim, for which I blame them rather than you.

You are using their study to claim that LLMs can not learn and reason about novel tasks. Their study doesn't make any claims about what LLMs can and can't do. The study says that when it appears that LLMs suddenly became able to reason about novel tasks, what actually happened is that the ability of the LLM to perform reasoning improved gradually and smoothly during its training until it could do those things. They are not saying that LLMs don't have emergent capabilities: they are saying that those capabilities emerged at a continuous rate rather than a discontinuous one.

Do you see?

Re:AI knows things no one told it by dS0rrow on Friday May 12, 2023 @07:21PM (#35923747)
> Do you see?

Emergence can only be discontinuous.

Re:AI knows things no one told it by epylar on Saturday May 13, 2023 @08:31PM (#35934215)
Emergent abilities can be gradual and continuous.
Re:AI knows things no one told it by dS0rrow on Sunday May 14, 2023 @04:40AM (#35936418)
If it's continious then nothing is emerging and it can be explained by the sum of it's sub-systems.
Re:AI knows things no one told it by fsflover on Tuesday May 16, 2023 @02:54PM (#35966060)
Is life itself not an emergent phenomenon? What is the cleat threshold? Viruses?