The concern I usually hear is not around the learning to program aspect. Instead, it's that fact that almost every other entry-level programmer is a college grad, and that hiring processes will be biased against older candidates.