> Because it often involves nothing more than being given a basic level of trust and respect that, once you have them, can seem like a bare minimum, not something that you would need to fight for.

This is exactly why privilege is not an accurate or constructive term to use in these conversations.

Privilege implies something undeserved. So it sounds like an argument for taking away those bare minimums, so everyone is equally treated with suspicion, condescension and hostility.

Better words are "oppression", "discrimination" and "bigotry". Make it clear that the goal is treating everyone with a basic level of trust and respect, as a bare minimum, and nothing less than that is acceptable.