In my anecdotal experience, it’s important to take of headphones every now and then to prevent moisture from accumulating in the ear canal. That moisture is unnatural and id probably very nice for various germs.