They've been labeled as such for much longer than that. My point is, the label doesn't make sense. Bill O'Reilly doesn't like them because they are a threat to some of his political causes, like civil rights for people he doesn't like (prisoners, alleged terrorists, illegal immigrants, etc.). The ACLU opposes the much of what every President does - that's the main threat to civil liberties - including Obama's surveillance programs, for example.
(for a Bush-era, Bill O'Reilly-ish-style definition of "liberal")
And yes, I think it's okay to reject them, because I am afraid of them gaining affection from everybody just to push an agenda later. If they wanted to herald digital freedom, they should have remained completely neutral in political issues, but they chose not to...
[1] https://en.wikipedia.org/wiki/American_Civil_Liberties_Union...
edit: The only questionable thing listed is their position on gun rights.
Rejecting the EFF and ACLU looks to me like partisanship over country or principle: We don't care what they are doing, we're going to reject them because there is some association with liberalism. Fighting liberalism is more important than civil rights or anything else.