The problem is that Glass wasn't an overlay, it was a screen near your eye.

The technology isn't ready for overlays; we can't take a picture, analyze it, and pipe a drawing to a display fast enough. If it's not fast enough you get lag which is confusing and distracting and wrong.