News for hackers. Stuff that matters.

A comment on OpenAI Codex. Parent comment

Re:OpenAI Codex by simsla on Tuesday August 10, 2021 @07:01PM (#28135885)
The problem with this (very popular) argument is that you can't give a CS course to a baby and expect them to get at programming.

By the time we see our first line of code, most of us have seen a ridiculous amount of data. We've been trained in problem solving, logical reasoning, maths, natural language processing, ... Hell, we've been trained as pattern matchers since we've been born.

By my account, humans actually need a large amount of training data. It might be the knowledge federation and generalisation that we're good at, but I don't think we're a clear winner in data efficiency.

[ Parent | on HN ]
Re:OpenAI Codex by randallsquared on Tuesday August 10, 2021 @09:39PM (#28136941)
Taking 11Mbps [1] as the raw uncompressed incoming data, and assuming 16 hours of waking environment consumption on average (likely high for children), a 13yo has taken in less than 400 TB of information (I used 11 * 60 * 60 * 16 * 365 * 13 / 8.) That's... surprisingly low.

[1] https://www.britannica.com/science/information-theory/Physio...

[ Parent | on HN ]
Re:OpenAI Codex by naresh_xai on Tuesday August 10, 2021 @11:15PM (#28137528)
Are we still limiting to visual cues and not the auditory,smell,taste,touch data which we get exposed to?
[ Parent | on HN ]
Re:OpenAI Codex by FeepingCreature on Wednesday August 11, 2021 @12:20AM (#28137986)
Visual input is so dense it's basically not worth tracking the other senses from a data rate pov.
[ Parent | on HN ]