That's very cool, but a LOT of production work.

Probably fails the cost-benefit analysis for most people doing Mixed Reality videos for their VR products. However, if it was productised, that'd be a different story.