Michael Abrash (of Oculus research) has given several good talks that discuss this. Here's one example: https://www.oculus.com/blog/vrs-grand-challenge-michael-abra...