News for hackers. Stuff that matters.

A comment on Quadrillion-parameter transformers and how to train them. Parent comment

Re:Quadrillion-parameter transformers and how to train them by wernam on Sunday November 08, 2026 @11:04AM (#50414402)
The grandparent comment is: "humans aren’t born with randomly initialised neural weights", with commenters throwing around harebrained hypotheses about those weights.

Most biologists will fully disagree with the whole premise, and support the reverse claim that we are born with random weights, we learn to walk/speak English/etc after we're born. Not from weights in our DNA.

[ Parent | on HN ]
Re:Quadrillion-parameter transformers and how to train them by AndrewDucker on Monday November 09, 2026 @05:25AM (#50423674)
Yes, but there is clearly DNA scaffolding needed. The closest related animals to us cannot speak English, no mater how much training they are given.
[ Parent | on HN ]