This is something I see employees worry about all the time, but I have never seen a business owner or person with hiring authority consider it. People who get to that position within a company learn to inhabit shades of grey; unless you personally did something illegal, they're not going to hold the company you worked for against you, except to the extent that they may think that people working at that company are incompetent.

I see ex-Facebook and ex-Uber employees popping up all the time at high positions within hot (and sometimes even ethical) growth companies within the valley.

Not a thing I’ve ever considered on a hiring front unless you’re famous as a sexual harasser or for pulling a Damore. Literally never heard of anyone doing this either.