> You're not free to not associate with people in the U.S.

I'm not? There are certain exceptions, such as certain police interactions, or a court order, or protected classes when I'm doing business stuff, but I don't think that's correct in general.