News for hackers. Stuff that matters.
Re:We have reached an agreement in principle for Sam to retu... by cft on Wednesday November 22, 2023 @07:18AM (#38378229)
Sutskever says there's a "phase transition" at the order of 9 bn neurons, after which LLMs begin to become really useful. I don't know much here, but wouldn't the monomodels become overfit, because they don't have enough data for 9+bn parameters?

There are no comments on this comment yet.