Re:We have reached an agreement in principle for Sam to retu...
by cft on Wednesday November 22, 2023 @07:18AM
(#38378229)
Sutskever says there's a "phase transition" at the order of 9 bn neurons, after which LLMs begin to become really useful. I don't know much here, but wouldn't the monomodels become overfit, because they don't have enough data for 9+bn parameters?
[ Parent
| on HN ]
There are no comments on this comment yet.