News for hackers. Stuff that matters.
Re:On the slow death of scaling by gwern on Wednesday January 07, 2026 @09:50AM (#46526975)
> I thought people recognized that they don't appear out of nowhere.

I don't think that paper is widely accepted. Have you seen the authors of that paper, or anyone else, use it to successfully predict (rather than postdict) anything?

Re:On the slow death of scaling by charcircuit on Thursday January 08, 2026 @12:22AM (#46537506)
I haven't paid attention and the paper seems to be arguing against the existence of the phenomenon of emergence behavior and is not related to predicting what is possible with greater scale.
Re:On the slow death of scaling by gwern on Thursday January 08, 2026 @09:15AM (#46541194)
> is not related to predicting what is possible with greater scale.

If they can't predict new emergence, then 'explaining' old emergence by post hoc prediction with bizarre newly-invented metrics would seem to be irrelevant and just epicycles. You can always bend a line as you wish in curve-fitting by adding some parameters.