News for hackers. Stuff that matters.
Re:OpenAI Codex by jacquesm on Tuesday August 10, 2021 @05:48PM (#28135089)
Takes on average 2.5 decades to train it.
Re:OpenAI Codex by mattkrause on Tuesday August 10, 2021 @06:19PM (#28135435)
That's just from the most recent checkpoint :-)

If you were to build it "from scratch" you'd also need to include the millions of years of (distributed) evolution required to get that particular kid to that point.

Tony Zador has some interesting thoughts about that, including"A critique of pure learning", here: https://www.nature.com/articles/s41467-019-11786-6)