"the real issue is how to display it"

Unfortunately, yes. I know that there are various sci-fi solutions in the labs already, of projecting the image directly into the eye, or correctly on the windshield while taking the head position of the driver into account, but it probably takes a long time till they are a) reliable b) affordable c) standard in every car