At the risk of showing just how ignorant I am of current state-of-the-art AI, it feels like the biggest block with self-driving cars is how short their memory is and how little high-level logic is implemented. The computer doesn't feel like it's driving the car as an activity so much as simply responding to inputs as they come into sensor range, sometimes correlated, frequently not.