If you don't even want to pull the phone out to begin with then you're most likely not hitting them up for their phone number unless they happen to have a card or you happen to have a pen and sticky notes.
It's possible that the people who are already too cautious to even reveal that they have a phone are the same people that would never make use of a service like this.
And that's not even what I was really thinking of... in poor countries the last thing you want to do is pull out a smartphone, let alone pass it to the doctor, tour guide, taxi driver or whoever you think is standing in front of you.