Perception works at 10-20 frames per second, all day long. That means 0.5 million perceptions per day. Why would a small neural net that has 1/1000 the experience of a child and 1/1000 the size of a brain (assuming it is 100 million neurons which is huge!) be able to be more accurate?
What you are referring to is called "one shot learning" and is the ability to learn from a single example, which is being studied in the literature.
These days one should be careful when claiming things deep learning can't do. There are in fact systems that can imagine things it has never seen before.
Here's an example. It takes any text, and imagines an image for it: https://github.com/emansim/text2image
Here's a more recent example, with even higher quality images: http://arxiv.org/pdf/1605.05396v2.pdf
On a purely visual level - let's say we have 10k of static 32x32 images defining a class of cat. Or even more of them plus some negative examples. Each image is a different cat, in a different position (they're incredibly flexible creatures). Having so many cases we should be trying to make some kind of a generalization of what 1024 pixels of a cat should look like.
A family with a toddler has only one cat. From that one example, he learns the concept of what a cat is and is able to generalize it when in different situations. But a toddler has 2 eyes, his visual input is stereo. Even if he sees just one cat, it's not a static image interaction. The input is temporal, he can see the cat moving and interacting with the environment.
This is typically referred to as "one-shot learning" in the literature -- and people certainly work on it!
One main thing it lacks is imagination. Humans can learn things and can imagine different combinations of those things. For example, if I ask you to imagine a Guitar playing Dolphin, you could imagine it and even recognize it from a cartoon even though you have never seen it in your life before. Not so for Deep Learning, unless you provide massive amount of images of Dolphins playing guitars.