360 degree video already exists: I believe it works by transmitting the entire output from 2 or more wide angle lenses and letting the viewer select an angle to display. Search for 360 video on youtube for examples.