Look at how many people drive off cliffs, into trees, or into other cars when a deer runs across the road. Vested interests in safety aside, it's always dangerous to do something unexpected in traffic.
So pedestrians can do whatever they want because its more dangerous for them? Did you know that a flashing red hand means "don't walk"? You can be ticketed by entering the crosswalk when it is flashing. How many of your close calls would that eliminate?
As a driver, what is your first instinct when you see someone in the middle of your path on the road? I also hate people who jaywalk onto medians - how do I know they're going to stop when they get there? Especially if they're running at full speed. I've also had several pedestrians almost jaywalk right out infront of my car before, some not noticing me until I honked at them (too close to stop).
We would all be safer if we all followed the rules. Not just cars.
Crosswalks are a problem because you can't predict car behaviour: some will stop. Some will completely ignore them (for reasons unknown). If there were no crosswalk you know exactly what cars will do. That's much safer for both parties.
The "illusion of safety" is most dangerous at traffic lights. 2-3 times I've had cars just sail through, completely oblivious. Note: they're sailing through on RED lights. Not amber going red. It's not one of those borderline cases.
Once I had a cop have a chat to me about jaywalking but I've never been fined. I would be pissed if I ever was. In a fight between a car and a pedestrian the pedestrian loses (big time) so pedestrians have a higher vested interest in their own safety. I know what the light changes are at intersections I cross a lot. Where are these cops when cars sail through red lights or nearly run over pedestrians when turning when the pedestrians have right of way?
I get the distinct impression these skills will come in handy when I move to New York next month!
Anyway, back to the self-driving cars: this I believe will be a painful transition that will take many, many years. It's nice to see Google working on this.