I really would say it's far safer than a taxi. Someone planning on robbing someone probably wouldn't use a GPS capable device to first have the potential crime scene come to them with continuous tracking the whole time, only to steal what they could get from basically anyone on the street.
Right now, we have two conditions where autonomous systems work well: on the highway, where you can use products like Delphi's sensor package to do adaptive cruise control and lane assist, and in more urban environments with very detailed maps (see the Google autonomous cars).
I actually think there's a good chance Uber can create very detailed maps of places like Manhattan and San Francisco, and make autonomous vehicles that can use these maps to drive around.
Uber is under such a microscope when it comes to drivers that it makes a lot of sense for them to sink the R&D into this problem. All the cost going into paying people, paying to find people, and paying to clean up when people make a mistake, goes away.
One thing people forget is that building cars is hard and expensive. Autonomous vehicles is not only about mounting some sensors and computers. Its about interacting with a slew of systems that were not designed for autonomy. A fully autonomous car that can drive people around like a Taxi requires a complete engineering overhaul from the wheels and up.