Our minds build internal models from what we are seeing. What you perceive of the world is pulled from this model, which is "running" in mind and is apparently 3D.

To effectively mirror this process in machines, we need models that can extrapolate a 3D environment and it's objects from sensors. If we can get an approximation of what something looks like from a different perspective, it's valuable for naviatigation and objective planning.

We could also theorize about the effects it will have on machine's awareness and attention.