From a religious perspective, sure. From an earthly perspective, you don't know what the other side was doing. Have you ever been married to a menopausal or a post menopausal woman? A marriage in which there is a permanent refusal to have sex can be annulled.