Whatever speed gains self-driving cars may attain by reducing time spent at a (now deprecated) traffic light or at an intersection/yield sign, people may just make more trips because road conditions have temporarily improved, thus cancelling that benefit.
Say you decide not to drive to work but instead take the rail because you don't want to deal with the hassle of traffic. Maybe the rail has its downsides too, but they are acceptable to you. Now if self-driving cars makes highway congestion to work better, you may just be that person who switches from rail to car.
Autopilots with superhuman reflexes and "telepathic" sharing of sensor data/intelligence could be used to increase the carrying capacity of roads by almost an order of magnitude. Photos of roads indicate that we are only using 1/10th of them to carry cars, spatially speaking.
It seems this is also true for cars and trucks. No matter how many roads we build, there is congestion. I think automated cars are going to show that one of the limiting factors to how much our society uses such transportation is the supply of piloting labor.
Also to chime in: It's not literally infinite. It's just much higher than the current economy can supply.