The way it was explained to me was that drivers have a harder time estimating the speed of fast-moving objects that are differently sized than an automobile, such as bicycles and trains.

Meanwhile, bicycles that go with traffic will (relatively) approach the driver at a much slower speed, giving the driver more response time.