We use math as a framework for reasoning about physical reality. When doing this we assume that the logic of our math holds for physical reality and that we can use it to make useful predictions. If a mathematical theory has held up so-far then that is evidence that it will continue to. It's not a guarantee, but it is evidence.