1) He called all birds ducks for the longest time, presumably based on being exposed to a bath duck, and this weird Youtube video about ducks swimming in the water.
2) Then he called some of them bird, based on being exposed to a bath toy bird.
3) Then he split them up a bit more... parrot, chicken, rooster, etc. He started seeing them in books and real life.
4) At no point could he explain the difference. Still can't.
5) And he definitely thinks the only difference between a rooster and a chicken is colorful feathers.
6) And he's not quite sure about ducks and geese, but usually gets it right.
Most prominently there's object recognition (telling things apart from the background, recognizing parts of objects, etc.), size/distance determination (which uses over a dozen separate algorithms: https://en.wikipedia.org/wiki/Depth_perception). We can also reconstruct a 3d model from a 2d image and compare that to our idea of what ostriches look like in 3 dimensions.
So even if it is done unconsciously, we recognize an ostrich because (among other things) it's the size of an ostrich. The NN has no idea what size is, let alone the size of an ostrich relative to other things.
I think the next big breakthrough in machine learning is in ensembles containing NNs trained for completely different things, but acting in a complementary fashion.
If we've only seen automobiles, then all of a sudden are introduced to trains, 18-wheelers, motorcycles, etc, we are challenged to conceptually organize and discover the differences between these classifications. There's still a fair amount of "feel" in weird overlap cases, but the conceptual distinction is created after the fact. There is no mechanism for that in NNs.
To my mind, that's EXACTLY how humans do it. A baby is not instructed, "it has 2 legs, feathers, and is tall, therefore it is an ostrich", there's quite a bit more "LOOK OSTRICH /present input of ostrich/" prior to the point of being able to generate any justification.
As sister posts have pointed out, I tend to believe that the ability to justify the classification is another learned skillset that comes later developmentally, the ability for higher primates (and babies) to perform classification without the (as far as I know) ability to do the higher order reasoning lends itself to this theory.