I think it's ok to infer someone holds and opinion (i.e. is libertarian, Stalinist, some other annoying internet political opinion) and to check out of the conversation if they do.