If child gets external reward for every waking moment until she is 12 years old, it's just 4.2 million signals.
Reinforcement learning works for fine motor control and other tasks where the feedback loop is tight and immediate. Reinforcement and conditioning can also modulate high level cognition and behavior, but it's not the secret sauce of learning.
Biological system don't live long enough to get enough feedback to learn complex behavior trough consequences. Animal or human must be able to generalize and categorize what they have learned correctly without external feedback teaching it how to derive the function that's doing it.
For example, if you want to learn how to tie a complex knot and learn it trough trial and error you might have try it million times if you improve your behavior mainly trough consequences of your actions. In practice you probably try only 5-10 times before you learn to do it and it involves pausing and looking at the problem. There is some kind of unsupervised model building happening that is not involving external input.
But it seems like (or one could misunderstand you in way that) you see those concepts as mutually exclusive. I would assume a combination of reinforcement learning and unsupervised (and supervised) learning.
Rats have been trained to detect landmines and then go back to their trainers and show them the mine. This is complex behaviour that was taught using reinforcement (at least on a top level). There will be some unsupervised learning going on in the rat's brain on a lower level. But it is complex behaviour and it's been reinforcement learnt.
I certainly don't. Reinforcement or conditioning is part of it, but it's not the cake.
Natural selection is not pure chance. At least seeing it that way doesn't yield anything except maybe lowered expectations. You want some expectations.
Hiding you theory behind Nature is not any less religious. Nature is pretty much synonym with living things, existence in general, and actually stems from to be born. Nature as the reason for things being born is thus kind of true by definition. The rational behind the generational evolution is the exact opposite of pure chance, though. Chance is only applicable if there are two possible outcomes. In hindsight, only one outcome was possible, so there are no chances, just facts.
The argument I am getting at is, self similarity seems to be such a common property, that it's maybe inevitable somewhere in a complex system. From there to self awareness and critical thinking is a long way to go, but what you call millions of years is a blink of an eye on a cosmological scale.
The idea of complexity includes enough variety to appear random to us, so we might agree that it's just a difficult to express concept and this is only semantic quibbling.
I think apparently unsupervised systems could be explained by models that predict a future input given their current state and input. Correct predictions are reinforced. An RNN-like model.
(If the network is small, it should learn some compressed representation, which can be used as an input to a more abstract layer that makes more general predictions over a longer time period)
If going through life you had artificial reality display that flashed "apple" in front of every apple and "orange" in front of every orange you would have reinforcement learning. There is certainly a major component of reinforcement in teaching, but that does not account for all of learning.
With humans we are able to transfer concepts to different situations without examples and there are a lot of categories that are identified without any explicitly reinforced examples.
Could one not argue that even unsupervised learning is kind of reinforced by let's say the emotion you obtain from successfully performing a learning task? Then the reward signal does not come from the external environment but from resolving cognitive dissonance in the brain.
Happy to be proved wrong by experts here.
While it seems intuitive that most individual "intelligent" systems in animals can be seen as unsupervised, isn't life itself driven in a reinforced manner?