I wouldn't say your view is "hateful" or "problematic" but trans men can give birth, and if they are ignored then their quality of care will be impaired. It's also important to note that it's necessary to be flexible about definitions or ackowledge that the words have different consequences in different circumstances.