To me, the obvious endgame is a 3D reconstruction of the image from the perspective of your eyes, so the screen becomes a "virtual window". I tried to pitch this to Skype a few years back, it felt like a no-brainer given that they were then recently acquired by Microsoft (which is big on similar technologies with Kinect and lately HoloLens). But they were completely uninterested! I think they were so used to Skyping that they didn't feel it was a problem.