suryaprakaz
"GPT-3, for example, developed its language model based on 45TB of text. Over a lifetime, a human reads and hears of the order of a billion words; a child is exposed to ten million or so before starting to talk."
What statements like this fail to consider is that the hardware the child's brain is made of is the result of millions of years of biological evolution, and evidently tailored to solve human-centric problems much more easily. But the child's brain is capable only of operating largely within the limits of its own subjective experiences (for ex: the experience of learning to speak a language). When we define AGI, it cannot be only under such anthropocentric terms. It needs to be able to solve a multitude of real-world problems with approaches that humans might never be able to readily comprehend. The solution space for these different kinds of tasks must be significantly high that there could be space enough for more than one way, i.e the "human way" to solve it. It's a narrow viewpoint to say that an AGI needs to learn in human terms.