Try passthrough on Oculus Quest 2 to get an idea of how easy this is to solve. It just uses the motion sensor cameras and it's pixelated and black and white, but you get some overlays and you can get a very good idea of how quickly this will be solved in full 8k hidef with overlays that look like they belong.