Yeah, this has really bugged me. People treat the phrase as though the proverb was "there will always be a few bad apples, no big deal, toss them when you notice them" - precisely the opposite of the point.

Not that reasoning by proverb is great in the first place.