Why not? If someone tries to coerce me like that, they're no longer my friend, because I cannot trust them, nor feel comfortable around them anymore.

But they can still be my wife's friend's husband, and that's how I am going to treat them.