There is a tool my supervisor always used to make me use to avoid this when posting to ArXiv: https://github.com/google-research/arxiv-latex-cleaner