It would be some other perceived flaw. People always do this. For example, someone wants to make the environment better and starts working for it. Then he gets to hear 'he drives a car!'. Suddenly he is not credible anymore.

To me, this all or nothing attitude is what makes most humans quite dumb.