I'm with Max, from Pi. To restate his first assumption: Mathematics is the language of nature.
Cue Clint Mansell...
Consider an EM field. Do you think there is some daemon grinding out complex exponentials as it propagates? In reality some spinny thing is rotating and moving through space. What those terms actually are isn't precisely known but the phenomenon closely fits a mathematical model we can elaborate on to do useful things. That doesn't mean it's how reality works.
And that's before getting into categorization issues. Does Pluto "exist" as a planet? It'd be pretty non-sensical to say it stopped existing when scientific authorities changed its designation. But then was Pluto really a planet before that happened? Or was its planetary status a figment of collective imagination?
I agree categorization is a (almost?) purely human concept. I'm not sure how that relates to my question.
Why does this relate to your question? Because we cannot prove _anything_ not to be an artifact of our perception, nothing that we conceptualize is necessarily inherent in reality. In a strict sense, reality is unknowable to us. In a practical sense, none of this matters because math seems to work well. Still, if we wish to be undogmatic, then we should approach questions of existence or non-existence with humility and not base ontology entirely on perceptual illusions.
Edit: To clarify better, the way you solve math is that first you solve the problem, then you figure out how to communicate the solution. This can either use language people created before or you create new language, you can just use English or you can just draw pictures and have no words at all. Either way you are doing maths.
A more non-trivial example: Say you want to say that 2 x 4 = 8. One way is to just write 2 x 4 = 8. Another way is to say that a finite set of cardinality 8 is the product of a finite set of cardinality 2 and cardinality 4 in the category of finite sets (in the sense that 8 satisfies the universal property of 2 x 4).
Language itself is an exclusive operation on the possible coordinates of anything within a universe.
E.g. the word “carbohydrate”, or it’s equivalent in different languages, describes a concept; but the concept itself exists independently of any language construct that describes it. Similarly, in math, a concept e.g. “prime number” is independent of the many ways and many languages you can use to describe it. It just is.