What I think the truth really is, is that we don't encounter quantum superpositions in an obvious way in our day to day lives. So it's inherently "weird" for us, especially since it seems to violate our notion of object permanence. But that doesn't mean it's wrong, it just means that one of our evolved instincts isn't applicable on a quantum scale.
I think that this puts it very well. If a theory doesn't fit with our intuition, then it might mean that the theory is wrong; but it's at least plausible that our intuition is wrong, and goes from plausible to overwhelmingly likely once the theory is backed up by experimental data. (Anyone, even or especially a scientist, who dogmatically trusts his or her intuition over science probably could do with a quick refresher in cognitive biases.)
We never progressed anywhere by saying "something just works" and leaving it at that. Challenge yourself.
I'm curious as to what you think consists of "an explanation" that's more useful than mathematics. Let's take a simple classical phenomenon to keep it easy, such as kinetic energy. The mathematical statement is E_k = 1/2 m v^2. What non-math explanation works better?
I think that the information can flow either way. For example, the existence of anti-matter, and portions of quantum mechanics (and, let's say, much of Witten's scientific work—though here I am tossing out a bit of folk knowledge, and couldn't point to anything in particular), are examples of letting the math guide the physics.
This is famously not true for the matrix mechanics in Heisenberg's picture of quantum mechanics and the Riemannian geometry underlying relativity, both of which were created without (so far as I, and history, know) any intended or perceived connection to physics.
On the other hand, I guess you could argue that that math was irrelevant to physics until Heisenberg and Einstein came along and found it an appropriate expression of their physical intuition.
Exactly.
It's interesting, but this "I challenge you to answer a philosophical (not scientific) question in a way that I find acceptable" approach surely skirts uncomfortably close to dogmatically creationist arguments.
(For the record, my answer, which certainly wouldn't satisfy Deutsch, is: it works because the math proves it works; there's no more "how" about it than there is in "how does the computation 10^(250)*10^(250) = 10^(500) work?")