This isn't even about cars (self driving or not) per se. It's about someone doing something different and all the comments amounting to this isn't how I'm used to things working, and I don't like change anyway. As Elon Musk puts it, you can't necessarily ask people what they want because the answers will be incremental updates to the status quo.

Since you insisted on cars: the short answer is that theres lots of evidence humans can't drive cars. It goes well 99.9% of the time and the rest ends up being 30000 people dead every year, many of them not in a car at their death. So they died for somebody elses convenience, and that turns out to be a rather common occurence with cars and all the things they bring along (just look for the free parking debate below). So the sentiment in countries that have had cars for a long a time and have seen the effects of that is shifting to no longer put up with it, certainly in cities where suburbia descends every morning.