I think that was a comment about families in general, not about these particular people.

I think that comment above yours was alluding to how many family gathering trainwreck conversations start: "I'm not (racist, sexist, homophobic, etc), but..."

The person you replied to was joking, because "I'm not racist but" is a classic opener from embarrassing family members.