If we’re throwing out anything that doesn’t have a proof of convergence as “not mathematically sound,” you can kiss fluid mechanics goodbye, as well as lots of other subfields of physics that rely on partial differential equations.