You know that the aphorism is "a few bad apples spoils the bunch", right? The underlying metaphor is that you have to get rid of the entire group because the infection has spread to all of them even if it's not immediately visible from the outside.