Having friends or even being married to X is a good sign to prove one is not racist towards X.

The inverse idea, that this is somehow a bad argument, I can't even fathom how it started (and how messed the minds of those that think you must somehow be a racist if you make this argument are).

(Sure, one can claim it hypocritically, just like everything else -- that doesn't mean the claim itself signals racism).