It probably gets worse the higher you go, because there is less grassy people adding marks to them, and less "people are hitting this too much, we'd better reduce that glass size". Birds are famous for getting them wrong.
Passive depth from stereo usually has big holes where no features are detected[2]. That's why Kinect and the like project their own IR texture into the scene. Outdoors ambient IR overwhelms the projection unless you use powerful lasers.
The upshot of this is that robots are vulnerable to banging into stuff, like bats.
[1] I don't know for sure but it's likely that the right hand side of this map I found online has glass walls causing bad range data: https://i.pinimg.com/originals/e0/87/04/e08704b6dc925b575c2f...
[2] If it doesn't, it's because the holes have been filled by interpolation - guessing what is there rather than observing it directly.
But won't lidar have the same issue, with a clean glass surface? Similar with stereo vision - if there are no features at the surface to correlate.