Scientists: Listen people! We have created models that explain why stuff does what it does! They are so complicated almost nobody can understand them. They involve 4 dimensions, a zoo of particles, randomness in everything and no reality independent of the observer. And they conflict. But at least they explain why stuff does what it does!
World: But they make the wrong predictions. Stuff does not behave like that.
Scientist: Oh, no problem. Just imagine there is an invisible force out there that moves stuff around. Imagine most of our universe is made of that invisible stuff. Now back to our awesome models!
We have well understood mathematical models which correctly and accurately predict all physical behavior relevant to our everyday lives, and, further, correctly and accurately predict the majority of our observations of the universe around us, period. As tools for understanding our world, they are incredible achievements.
In spite of us knowing these models to be fundamentally incomplete, we have yet (to my understanding) to perform an experiment on Earth which contradicts them. More to the point, the theory which supersedes them will, by virtue of needing to replicate all experimental results so far, will likely be even more esoteric, complicated, wild, baffling, and impenetrable (and--with any luck--elegant, inspiring, and beautiful).
accurately predict all physical behavior
Now you made me curious. What is the non-physical (metaphysical?) behaviour that we cannot predict?