Takes on average 2.5 decades to train it.
Re:OpenAI Codex
by mattkrause on Tuesday August 10, 2021 @06:19PM
(#28135435)
That's just from the most recent checkpoint :-)
If you were to build it "from scratch" you'd also need to include the millions of years of (distributed) evolution required to get that particular kid to that point.
Tony Zador has some interesting thoughts about that, including"A critique of pure learning", here: https://www.nature.com/articles/s41467-019-11786-6)
A typical brain has 80-90 billion neurons and 125 trillion synapses. That's a big freaking network to train.
Hopefully we can figure out how to train parts of it and then assemble something very smart.