1. Some people just enjoy driving their cars, tinkering with them from an automotive perspective and the like, self-driving cars will inhibit that due to their heavier reliance on software, design differences and lack of modification abilities as opposed to today's vehicles, self-driving cars won't gain acceptance from that crowd for a while.
2. The first accident that is caused by a self-driving car will cause a major set-back in the eye of the public, airplanes are over-engineered for the sake of redundancy and safety and I don't believe that level of detail will be applied to self-driving vehicles, honestly. Government standards will be met and companies will achieve the best safety ratings they can because it just doesn't hurt your product to have that as a selling point(I purchased my last vehicle for my family almost solely on it's high safety ratings) but sooner or later a self-driving vehicle will cause a casualty or injury.
3. Control and change, it is a complete paradigm shift for transportation as a whole and it will take a while some people to want to adapt or change with the times, a lot of cars are driven for sentimental reasons, the self-driving car tends to pull away from the romantic image of a vehicle(road trips come to mind as an example).
4.Cost, Self-driving cars bring a whole new level of technology to the consumer, how will that be handled from a financial perspective? Car dealers aren't known to be consumer friendly. Will there be economy models available? What about the individuals who just can't afford a self-driving car and are fine with a non-self-driving vehicle, individuals who can't afford to purchase a new car at all?
In New York City, a taxi driver takes home maybe 50% of the money collected in fares after costs (whether depreciation on their own car, renting a taxi by the day or week, gas, etc.) That may be high but it's a nice round number.
If we take this as a general rule of thumb (and NYC cabbies make more than the average), that means you could but cab fares by roughly 50% by eliminating the driver. Maybe that forces a behavioral change on the part of some urbanites. But I can pretty much guarantee you that cutting cab prices by 50% will minimally affect behaviors in most places.
And that's not even counting the many places where having the most rudimentary cab services is barely a cost-effective business today.
Sure, you can speculate about optimized taxi designs (which aren't especially relevant to non-core urban areas with high car ownership today) but small electric vehicles could exist without self-driving too.
IMO this is an academic exercise for at least a couple of decades in any case but it's an interesting thought experiment.
Snow, of course. I live in Salt Lake, and I think it's going to be hard to automate a car to drive as well as a good, experienced snow driver.
I've hydroplaned once.
I've had a malfunctioning traffic light that gave me a green left turn arrow across oncoming traffic that also had a green.
I've seen an unattended baby stroller go coasting across a crosswalk just as the light turned green.
I somewhat often take my car onto dirt roads. Sometimes I have to be rather conscious of the clearance and where the rocks are so that I don't rip the bottom out of my oilpan. I also have to think carefully about how I approach the sandy patches so I don't get stuck.
My brother in law had his front brake lock up on one side while driving at freeway speed.
I've had the vehicle in front of me break an axle and drop a rolling tire on the road in front of me, while it went down the road dragging the brakeshoes on the ground. That happened on a cloverleaf; the driver of that vehicle did well not to roll it.
Maybe the worst I've seen: A pickup dropped an extension ladder in the middle of the freeway. It was rotating, and as it rotated, it grew in length. A bunch of cars were having to dodge it, plus dodge the cars that were dodging it.
There are a lot of crazy things that can be thrown at you while you're driving. Programming a computer to be able to handle all of them as well as a human is really hard - you first have to think of all of them.
* Auto-dimming touchscreen
* Automatic windshield wipers
* Autopark - perpendicular
* Display cars in other lanes
* Side collision avoidance
* Side collision warning
* Sign recognition
It's also still steering itself off the road in places AP1 worked fine. There are videos over at r/teslamotors on Reddit or the TMC forum.
That seems crazy that automatic windshield wipers aren't enabled... my 2008 Honda Civic has those!
Didn't check /r/Tesla and /r/SpaceX lately so I don't know what the current value is, but Elon Time coefficient used to be something around 1.7 or 1.8 ;).
I think you're very optimistic. Bear in mind that Musk often over-promises on timelines (for instance, he said the new in-house autopilot in the Model S would have parity with the old outsourced one by the end of 2016, it still doesn't), and it will take sometime to regulate and legislate a whole new set of laws and structures around self driving (especially around matters of liability in the case of accidents).
I can imagine in 2 years we see more complex and intelligent implementations available for the general public that can manage route mapping and full autonomy in an ideal situation (you'd better hope its not snowing), but where drivers are still required to be present and have their hands on or near the wheel at all times.