We already tried this and have seen the results. We rounded up and deported more than a million Mexicans twice in our history. It is remembered, California apologized for their hand in it a couple of years ago.
Millions of families could be uprooted, torn apart and be left stranded without ID, possessions or money[1] and left to die[2]. Mothers, fathers, aunts, uncles, brothers, sisters, friends, neighbors, co-workers and classmates could disappear.
My perspective is that 'exactly as bad as the Holocaust' isn't the bar to pass to be a potential tragedy.
I didn't make a comparison to the Holocaust, but since we're there: deportation and mass ordered removal is part of what made the Holocaust a tragedy. It took years of deportations (of the traditional sense), forced relocations and imprisonment before people were shipped to the ovens in droves.
[1] http://immigrationimpact.com/2016/04/07/deported-immigrants-...
[2] https://en.wikipedia.org/wiki/Operation_Wetback#Consequences
(Also, if the Holocaust had only consisted of mass deportations it wouldn't be nearly as bad or remembered. Have some perspective.)