> congested intersections where you'd probably need to wait 3 hours to pass through legally

I cannot imagine how self driving cars will (in the future...) deal with entering the Lincoln/Holland/etc. tunnel. I genuinely don't think you can enter these tunnels even during moderate traffic without breaking at least a few laws.