My fundamental problem with this viewpoint is that people appear to radically underestimate the amount of training data (all of it incredibly rich in context) that humans have had access to over the course of their lifetimes.