> Are there general laws governing "learning"?

This has been my question too...

Based on my understanding, it all really boils down to probability, statistics and a few important theories like Vapnik-Chervonenkis which provides the mathematical foundation for what "learning" is, can we even learn from the given data and how well can we learn (VC dimension, etc).

But I would love it if someone can point me to or explain / derive from core first principles the concept of "learning".