You need to try this stunt in France then because you are totally misguided about "most people." I've had scared reactions from people in front of me just for looking at my own camera's pictures.

The climate in France is that people should not get photographed without their permission. Even further, some claim that taking photos of their house is too much. So the whole atmosphere is a by-default hostility to photographers, which should be extra careful.