I think we can both agree that reality (the physical universe) is well-ordered, self-consistent, and eminently logical in its operation. (Side note: my own belief is that it exhibits these qualities because it reflects the character of its Creator.)
And yes, it obeys certain concepts with absolute constancy - which we have worked to discover and which our mathematical language describes.
But I still maintain that the math and physics knowledge we have is at best limited and at worst an incomplete set of poor approximations. Because they cannot (and I maintain they won’t ever) account for everything we observe, or answer every question we have about the universe, and because its axioms have led to all sorts of abstract structures that have no relation at all to anything ever observed, I still think it’s fair to call math “invented”.
That being said, the real concepts we attempt to grasp in what we observe of the universe are clearly vastly superior to our comparatively small efforts to understand and model them.