Unfortunately there is a very, very, large set of possible situations a car may find itself in that requires 'user intervention'. Especially without much context-aware systems, or AI, the best error handler a driver-less car has is "stop, inform driver". Is there a curb to pull over to? What if the system is unable to determine if the path is clear because something like a branch is in the way?