News for hackers. Stuff that matters.
Re:LLMs understand nullability by uh_uh on Tuesday April 08, 2025 @02:16PM (#43624815)
Examples of emergence:

1. Multi-step reasoning with backtracking when DeepSeek R1 was trained via GRPO.

2. Translation of languages they haven't even seen via in-context learning.

3. Arithmetic: heavily correlated with model size, but it does appear.

I could go on.

Albeit it's not an LLM, but a deep learning model trained via RL, would you say that AlphaZero's move 37 also doesn't count as emergence and the model has no understanding of Go?

There are no comments on this comment yet.