Not meaning to infringe on the unassailable beauty of mathematics, but the statement that it is “perfect” requires some qualification.

Something like “it achieves exactly what it sets out to do?”

Given your definition of perfection and why math fits it, is there anything else that fits the definition?