I always suspected this but my guess is that it would need to mimic the way that stereoscopic vision sees it. Kind of see through. It might require eye tracking to make it really work well.