It would be a major breakthrough if the model wasn't trained on math at all. Which I suspect is the case here, because otherwise it doesn't make sense.