I think a mixture of both would be cool, like augmenting card games by placing the cards on a surface that has a screen or an overhead projector, but you're right in that a large part of playing a board game is the physicality of it.

Sigh, with Google glass I thought AR was finally going to become a thing, but there still aren't any lightweight/slim AR glasses that are readily available.