If I feel extra contact with someone is inevitable, I usually try to request that the person email me some helpful info that I need. If they say they'll "just call," I point out that [list of people] might find it useful, and joke that I can't forward them a phone conversation we've had. Some people still insist on calling, and I let them.
It's just those formalities of phone call that put me off, unless your close to a person focusing just on the question you have can come off as rude.