Re:OpenAI Codex
by maxwells-daemon on Tuesday August 10, 2021 @03:43PM
(#28133298)
I would argue humans ingest a lot more than 159GB before they can write code. Most of it isn't Python, and humans currently transfer knowledge a lot more efficiently than NNs, but I suspect that'll change as incorporating more varied data sources becomes feasible.
[ Parent
| on HN ]
We generalize pretty well. One could say: "it took you 20 years to learn python!", but actually I learned python, Java, c#... Software engineering, machine learning... How to play guitar, how to cook.. .How to speak Portuguese, how to speak English... And thousands and thousands of different things which build on each other.
You can give a programmer a few kb of code in a new language and that will give him a small grasp of how it works.