Both being considered evil by a significant portion are a direct result of their own past actions. Saying "it is unfair to be judged morally for your actions while in power" is fundamentally about as much of an excuse as "I didn't shoot the guy I paid people to do it and they were just following orders so really nobody is at fault here!"

ICE's conduct isn't following the laws unless there were changes that called for putting tearing children away from families to place in steel cages in the custody of known child molesters and psychotropically drugging children without specialized medical licensing. Even if you accept their job the way they beyond the pale. They are literally acting in ways that would get a work critically panned as having such cartoonishly evil strawmen villains a few years ago. Don't fall for the hypernormalization efforts.