Re:Explainer: What's R1 and Everything Else?
by jcgrillo on Sunday January 26, 2025 @08:57AM
(#42830126)
No, I don't think it's overly harsh. This hype is out of control and it's important to push back on breathless "exponential" nonsense. That's a term with well defined easily demonstrated mathematical meaning. If you're going to claim growth in some quantity x is exponential, show me that measurements of that quantity fit an exponential function (as opposed to some other function) or provide me a falsifiable theory predicting said fit.
[ Parent
| on HN ]
Re:Explainer: What's R1 and Everything Else?
by kingkongjaffa on Sunday January 26, 2025 @09:22AM
(#42830255)
I believe they are using 'exponential' as a colloquialism rather than a strict mathematical definition.
That aside, we would need to see some evidence of AI developments being bootstrapped by the previous SOTA model as key part of building the next model.
For now, it's still human researchers pushing the SOTA models forwards.
When people use the term exponential I feel that what they really mean is 'making something so _good_ that it can be used to make the N+1 iteration _more good_ than the last.
Re:Explainer: What's R1 and Everything Else?
by sandworm101 on Sunday January 26, 2025 @12:02PM
(#42831558)
Well, any shift from "not able to do X" to "possibly able to do X sometimes" is at least exponential. 0.0001% is at least exponentially greater than 0%.
Re:Explainer: What's R1 and Everything Else?
by jcgrillo on Tuesday January 28, 2025 @12:55PM
(#42855555)
I believe we call that a "step change". It's only really two data points at most so you can't fit a continuous function to it with any confidence.
Re:Explainer: What's R1 and Everything Else?
by flux3125 on Sunday January 26, 2025 @10:19AM
(#42830603)
>No, I don't think it's overly harsh.
Where's the falsifiable framework that demonstrates your conclusion? Or are we just supposed to trust your intuition?
Re:Explainer: What's R1 and Everything Else?
by brookst on Sunday January 26, 2025 @11:33AM
(#42831270)
Why is it “important to push back”? XKCD 386?
Re:Explainer: What's R1 and Everything Else?
by cubefox on Sunday January 26, 2025 @09:43AM
(#42830364)
> It's a bit crazy to think AI capabilities will improve exponentially. I am a very reasonable person, so I just think they'll improve some amount proportional to their current level.
https://www.lesswrong.com/posts/qLe4PPginLZxZg5dP/almost-all...