Some "can't be handled".
Just because Google or Honda's implementation (based on a camera) is geared toward a specific implementation, doesn't make it the best. Cruise Automation has the right idea with sensor arrays that make fog and rain a non-issue. There are lots of options.
I personally think this is going to be a huge problem with self-driving cars. They can't go anywhere if any of their sensors are faulty. And they need to have hundreds of them to work in all conditions. Ideally, you would want to have sensors in every wheel to tell you the pressure, sensors that tell you if there is ice on the road, sensors in literally every part of the suspension to monitor if you haven't suffered a broken coil or damaged bearing that could cause an accident - and those things break. Even such a simple thing as pressure monitors in modern cars are notorious for breaking down. Anyone who has driven a 5-10 year old car will know that there always is something broken. In cause of automatic cars pretty much every problem is a breaking problem that immobilizes the vehicle completely, and I think people will get tired of that pretty quickly.