Let's take your example a little further, starting with the perhaps more general: "Do you believe in a higher power?".
I agree that it is impossible to disprove the existence of a higher power, however I do think it is possible to prove (not that I think it will be proved, ever). Things that were previously taken as evidence of such a proof are now generally accepted as natural phenomena (lightning as a crude example).
The nature of what would prove the existence makes for a much more interesting argument than the mere possibility of existence.
"Do you believe that the higher power interacts with this universe?"
"Do you believe that we can measure that interaction?"
"What would that measurement look like?"
"Why haven't we actually measured that?" (perhaps a loaded question!)
If someone chooses to believe in a higher power that is unable to interact with us, and has no impact on anything we do, good for them! Potential issues arise when people believe that the higher powers does interact with the world, and so I find that discussion much more interesting than merely if such a thing could exist or not.
You don't believe in something just because you cannot disprove it. You must have some evidence to believe it in the first place. Otherwise, you would believe in all kinds of celestial teapots.
Generally when that happens to me I've come across what I like to call a "fundamental argument." Where neither party is correct and neither party is wrong. A good example of this is "do you believe in religion" because nobody can prove or disprove the existence of a higher being or a religion. But some people will fundamentally be okay with believing in a higher power though. So whatever side of the debate I'm on, when the conversation comes down to a fundamental argument I let both parties be right.