> I've gotten looks from taxi drives in south Europe for this, they treat it as an insult. I feel it's better to insult than be dead.

It's easier than that -- just tell the driver you're not worried about him or her, but about the other drivers on the road.