The amusing thing is that people assume autonomous vehicles are a deep learning problem. So far, the pure deep learning people haven't done all that well at it. Most of what Waymo does is geometry and sensor fusion. Visual object recognition and future behavior of moving obstacles is used, too, but that's not the core of the system. Look at their videos, showing an above view of what's around the vehicle and "fences" showing where it shouldn't go.