Edit: To clarify better, the way you solve math is that first you solve the problem, then you figure out how to communicate the solution. This can either use language people created before or you create new language, you can just use English or you can just draw pictures and have no words at all. Either way you are doing maths.
A more non-trivial example: Say you want to say that 2 x 4 = 8. One way is to just write 2 x 4 = 8. Another way is to say that a finite set of cardinality 8 is the product of a finite set of cardinality 2 and cardinality 4 in the category of finite sets (in the sense that 8 satisfies the universal property of 2 x 4).
Language itself is an exclusive operation on the possible coordinates of anything within a universe.
E.g. the word “carbohydrate”, or it’s equivalent in different languages, describes a concept; but the concept itself exists independently of any language construct that describes it. Similarly, in math, a concept e.g. “prime number” is independent of the many ways and many languages you can use to describe it. It just is.