News for hackers. Stuff that matters.
Re:StarCoder and StarCoderBase: 15.5B parameter models with ... by hannasm on Tuesday May 16, 2023 @12:08AM (#35957657)
The training process is finding local minimums based around an initialization vector of random numbers. 1000s of years of evolution probably mean you were initialized better than a baby AI using a pseudo random number generator.
Re:StarCoder and StarCoderBase: 15.5B parameter models with ... by ddalex on Tuesday May 16, 2023 @03:11AM (#35958611)
Watching my kid learn to speak made it clear to me that we are pre-wired for the acquisition of language - we're not building the structures from scratch, we are learning to put words into the empty spaces. Probably natural evolution at best - no speech, lower chance of gene propagation