Math is pretty fundamental, it is the basis for a lot of what people do in modern society and provides a better basis for solving many problems than the alternatives.

Universal literacy is a relatively new concept that civilization went a very long time without. One can make the argument that it is not really necessary for communication or learning.

I don't really believe there is such a thing as not being 'wired for math' any more than there is such a thing as not being 'wired for reading'. Absent mental impairment it is something that can be learned, it's just that we generally do a terrible job of teaching it.