The issue is not the man, it's the policy.
But how do you separate the man from his policies? That would be like trying to separate a man from his religious conviction. A mans policies reflect what he believes in.
The constitution asks us to separate religious conviction from public policy so I don't think it is that outlandish. The government is supposed to represent all people not just the politician's beliefs.
They are not anti-Trump, in that if Trump rescinded his problematic EOs, the ACLU would stop fighting him. The issue is not the man, it's the policy.