You can see it as a simple optimization. The map can be considered mostly invariant.

For example, why would you need to waste resources to check over and over if this tree is a pedestrian, a car, a dog or a cyclist ?